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ABSTRACT 

This study investigated the degree of teacher evaluation 
policy implementation in Alberta, the events which influenced 
teacher evaluation policy adoption and the variables which 
affected the policy implementation process. 

The information required for the study was secured through 
interviews and documents analysis. The first phase of the study 
was primarily qualitative, using semi- structured interviews of 
selected key decision makers and leaders in teacher evaluation in 
Alberta. Snowball sampling with key leaders and decision makers 
was used to identify a sample of these key individuals. That is, 
the first person interviewed, a former Minister of Education for 
Alberta, was asked to recommend others (Bogdan and Biklen, 
1982:66) c A primary purpose of this phase was to identify the 
historical background, the purposes and intents of teacher 
evaluation policy visualized in the policy planning stage, and to 
determine the educational leaders 1 perceptions of the degree of 
implementation of teacher evaluation policy in the province of 
Alberta • 

In addition, 30 teachers, 30 principals and 30 
superintendents or their designates were interviewed regarding 
their perceptions of teacher evaluation policy implementation. 
Phase II interview schedules with policy implementors were 
determined by findings from phase I interviews with policy makers 
and by the variable clusters from a policy implementation model 
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(Van Horn and Van Meter, 1977). Thirty of 146 active Alberta 
school jurisdictions v/ere randomly selected from the Alberta 
School Jurisdiction List, 1986 for inclusion in this study. In 
order to assure a representative sample of jurisdictions, the 
population of jurisdictions was stratified on the basis of type 
of jurisdiction and geographic zone. Jurisdictions were then 
selected frora each stratified grouping using a random numbers 
table. 

Among the key recommendations from the study were: 

1) the often held perspective of local policy implementors 
that teacher evaluation policy adoption by the Alberta Department 
of Education was a short term reaction to a single event, the 
Keegstra affair, should be corrected with the view that policy 
adoption was a more legitimate long term reaction to multiple 
factors; 

2) provincial policy objectives should be adjusted to 
recognize and support the more formative emphasis teacher 
evaluation has been given at the local level; 

3) given the finding that implementors perceived provincial 
commitment dissipating, provincial interventions are needed to 
maintain a climate in which teacher evaluation policy 
implemer'tation is perceived as being important; 

4) given the finding that lack of time was frequently 
mentioned as a barrier to implementation, recognition that 
implementors may need assistance in more efficient use of their 
time to support teacher evaluation policy should become a 
priority of jurisdictions and the Department of Education; 
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5) given the finding that articulation between the five 
provincial evaluation policies was often perceived by 
implementors to be unclear , the Department of Education should 
review the five provincial evaluation policies included in the 
Management and Finance Plan in order to define an optimal , 
articluated relationship between the five policies; 

6) given the finding that teachers report less involvement 
in policy development than perceived by administrators, as part 
of a policy and instruments review process, mechanisms should be 
considered which maximize teacher involvement in the process in ■ 
order to increase the sense of teacher ownership of teacher 
evaluation policies and processes; 

7) given the finding that administrator implementors appear 
to feel a need to demonstrate a degree of implementation that is 
not congruent with the expectations of the policy makers, 
clarification of realistic timelines for full implementation by 
policy makers would be useful. 

The study also included a documents analysis of teacher 
evaluation policies and teacher evaluation instruments from the 
30 jurisdictions included in the study. The analysis of these 
documents present useful analytical frameworks for jurisdictions 
to conduct reviews of their present policies and evaluation 
instruments. 
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CHAPTER ONE 



Teacher Evaluation Policy Implementation 

Introduction 

Governmental and societal concerns for excellence and 
accountability in education are evidenced by mandated evaluation 
strategies required of school jurisdictions. Numerous reports 
and studies in recent years, the most notable, A Nation At Risk 
(National Commission on Excellence in Education, 1:983), A Nation 
Prepared: Teachers for the 21st Century (Carnegie Task Force, 
1986) and Tomorrow's Teachers (Holmes Group, 1986) have 
questioned the effectiveness of schools and the capabilities of 
teachers. Within Canada and in Alberta specifically, reports 
have focused on student achievement levels (Alberta Education, 
1979), on teacher education (Alberta Education, 1984a) and on 
teacher evaluation (Alberta Education, 1984b) . 

Concerns regarding the quality of education are often 
translated into policy initiatives by state or provincial 
departments of education. Policies adoption, however, does not 
guarantee implementation. In fact, recent research on policy 
implementation has revealed the process to be complex, 
interactive and fraught with numerous barriers. Policy 
implementation studies based on comprehensive policy 
implementation models can help explicate and clarify the 
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variables and processes important to policy implementation in 
support of educational reform. 

This study investigates the implementation of teacher 
evaluation policy in Alberta, Canada. An integral part of *-.he 
Alberta Department of Education's Management and Finance Plan 
(MFP) is an evaluative feedback loop focusing upon five levels of 
school jurisdiction operation: student, teacher, program, school 
and school system. 

The purpose of teacher evaluation in Alberta is elaborated 

in the Department of Education's Program Policy Manual (1984:69) 

which states "... use [of] the results of evaluations [is] to 

iaaprove further the quality of education. ..." Policy 

regarding teacher evaluation as specified in the Program Policy 

Manual (1984:72) is as follows: 

The performance of individual teachers and the 
quality of teaching practices across the province 
will be evaluated to assist in the provision of 
effective instruction to students and in the 
professional growth and development of teachers. 

The Alberta Department of Education places primary 

responsibility for teacher evaluation processes with the school 

jurisdiction, but specifies that local policies will complement 

provincial policy, primarily with respect to due process 

procedures. 

Public and governmental efforts to monitor the internal 
processes of teaching represent a complex undertaking. The scale 
of the task leads one to suspect that the capacity of the 
teaching profession to buffer itself from change by virtue of its 
size and technical complexity is a very real possibility. On the 

io 
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other hand, well designed, carefully planned and implemented 
teacher evaluation policy which is incorporated into the 
organizational culture of the schools holds the promise of 
increasing the effectiveness of school, nnd thus positively 
affecting the morale and professional stature of the teaching 
profession. 

The educational community in Alberta is confronted with the 
need to implement regular teacher evaluation mandated by 
provincial policy, but implementation is clouded by the 
complexities of policy processes. Teacher evaluation policy 
implementation should be seen as a long term endeavor, requiring 
coordination and cooperation among all stakeholder groups. An 
analysis of the political, bureaucratic and technical dynamics of 
implementing policy on teacher evaluation will help to define and 
support the policy implementation process. 

Statement of the Problem 

This study is designed to determine the degree of teacher 
evaluation policy implementation in Alberta and to investigate 
the variables which influence the policy implementation process. 
The essential questions and sub-questions to be addressed include 
the following. 

1. What events affected teacher evaluation policy adoption 
and implementation in Alberta? 

a. What were the policy intents held by the policy 

makers? 
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b. What social structures or informal networks 
affected the policy process? 

c. What were the anticipated ideal policy intents of 
the policy makers? 

d. What were the perceptions of policy makers of the 
current status and possible future outcomes of teacher evaluation 
policy? 

2. What were the perceived policy intents held by policy 
imp! ementors and were perceptions of intents between policy 
makers and implementors congruent? 

3. To what degree have policy standards and resources 
affected teacher evaluation policy implementation? 

4c To what degree have communications, enforcements/ 
characteristics of the implementing agencies, political 
environment, and cocio-economic environment variables affected 
teacher evaluation policy implementation? 

5. To what degree has the disposition of implementors 
variable affected policy implementation? 

6. What were the policy effects perceived by policy 
implementors and were perceptions of effects between policy 
makers and implementors congruent? 

7. How similar were the expectations of policy makers and 
implementors for full implementation of teacher evaluation 
policy? 
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8. What future adjustments to teacher evaluation policy 
implementation were perceived to be needed by policy makers and 
policy implementors? 

9. What were the similarities and differences evident in 
Alberta school jurisdiction's teacher evaluation policies and 
instruments, and were the written teacher evaluation policies and 
instruments supported by the study findings? 

Answers to question one are found in Chapter Four. 
Questions two and three are addressed in Chapter Five and 
question four is discussed in Chapter six. Questions five 
through eight are dealt with in Chapter Seven and question nine 
is covered in Chapter Eight. 

Significance of the Study 

This study is seen to have significance for research and 
theory development and for the practice of policy implementation 
in educational settings. A consideration of the potential 
contributions of the study for research and theory and for 
practice is presented next. 

Re search and Thoorv 

Scheirer and Rezmovic (1983:620-621) suggest, "For policy 
innovation, the definition of full implementation may be 
essentially a political decision. 11 Given the potential for 

ERIC 18 



6 



non-rational factors affecting policy implementation, Scheirer 
and Rezmovic (1983:621) recommend, "Ideally a definition [of 
policy intents] is put into researchable terms after consultation 
with legislators, policy administrators and local service 
deliverers. " 

Other authors, including Newcombe and Conrad (1981), Hansen 
(1983), Elmore (1979) Van Horn and Van Meter (1977), also argue 
for a divergent analysis of policy implementation and suggest 
that multiple perspectives, such as organizational behavior, 
planned change and educational politics are useful frameworks for 
analyzing policy implementation. 

Several authors, Dror, (1981), Berman, (1978), O'Toole, 

(1986) have focused on the need for multi-variable models to 

facilitate policy research. Dror (1981:98) comments, 

The enumeration, classification and elaboration of 
policy instruments constitute another very 
important subject for policy sciences. . .to 
arrive at as exhaustive lists as possible of the 
different variables which can be used as policy 
instruments, and to study their domains of 
applicability. . . . 

Berman (1978:159) suggests, "The faint lines of a framework 
[of implementation studies] may be emerging . . . .» Berman 
(1978:180) concludes that 

. . .implementation analysis could make a major 
contribution to more effective policy by 
developing institutionally grounded heuristics to 
help policy-makers adapt their decisions as 
implementation problems arise. 

O'Toole (1986:183-184) examined more that 300 policy studies 
covering almost all major fields of policy and noted, 
"Researchers do not agree on the outlines of a theory nor even on 

w 
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the variables crucial to implementation success." While 0 1 Toole 

(1986:189) disparages the lack of convergence in the field of 

policy research, he admits the possibility of building such 

convergence and suggests several proposals for doing so. In 

addressing his proposals, O'Toole (1986:203-204) states, 

The review of the empirical literature suggests 
some implicit agreement on several clusters of 
variables deserving of further intensive 
investigation. Efforts should be undertaken to 
build systematic and cumulatively on the research 
that has focused on policy characteristics, 
resources, implementation structure, implementator 
disposition, implementor-client relationships, and 
timing. Several efforts in the implementation 
literature stand out as promising and worthy of 
more careful testing and development. Some 
[including the Van Meter and Van Horn model] 
sketch interesting models or rudimentary 
theories of the implementation process. 

The present study, based on the Van Horn and Van Meter 

(1977) model, is intended to provide information to both 

policymakers and policy implementors regarding the process of 

teacher evaluation policy implementation. 



Potential Contributions to Practice 



Policies, Rubin (1984:8-9) notes, 

. . .normally outline a plan of action. . .[and] 
can be used to identify specific goals. . .to 
establish mandates, to provide guidelines. . .to 
outline a problem-solving strategy. . .to 
sanction behavior. . . or to achieve consistency. 

Teacher evaluation policy in Alberta has nil of the elements 

Rubin mentions. According to the Department of Educations MFP 

Manual, teacher evaluation policy outcomes are intended to have a 

positive impact on the quality of teaching. And yet, poorly 
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implemented teacher evaluation policy can conceivably have the 
opposite effect. Popham (1986:56) believes • .the 
implementation of large-scale teacher evaluation systems may, in 
the long term, have an adverse effect on the quality of 
education. 11 An implementation study is needed to provide timely 
process information to allow any necessary adjustments to occur. 

Teacher evaluation policy development and implementation in 
Alberta is a local jurisdictional responsibility, but local 
policies must meet provincial guidelines, especially with respect 
to the due process criterion. 

Each Regional Office of the Alberta Department of Education 
was responsible for receiving policies for school systems in its 
zone, but not all policy elements could be assessed from an a 
priori review of policy documents. Many items, such as, "How 
well is the process communicated", "What resources or personnel 
are available to assist", and "What is the importance of teacher 
and supervisor commitment to follow up on the findings of ongoing 
evaluation" need to be assessed during implementation of the 
policy. Consequently, a comprehensive evaluation of the policy 
implementation process, conducted in the field in a randomly 
selected sample of school districts is needed. Smith (1973:208) 
suggests, 

. . .the idealized policy's function and 
relationships can be itemized and then compared 
with the actual outcomes of the implementation 
process. It is possible that in some instances 
the patterns of the idealized policy have never 
materialized or that the outcome of the change 
process has been to crystallize patterns of 
resistance to the idealized policy's program and 
goals. 
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Coleman and LaRocque (1983:245) argue that to be policy 

relevant, policy research should be 

. . .concerned with causality, with the complexity 
of the problem and the setting in which it exists, 
and with the utility, that is, the possibility of 
policy-makers acting on the findings and recommen- 
dations. 

Other authors, including Dror (1971), Dunn (1981), Mazmanian 
and Sabatier (1981), Gove, Whit and Walker (1985), Seidman 
(1983), Mos'^r (1977), Scheirer and Rezmovic (1983), Scriven 
(1979), Smith (1973), Newcombe Conrad (1981), Borich (1983), 
Edwards and Sharkansky (1978), and Van Meter and Van Horn (1977) 
support the need for policy implementation studies as a means of 
improving social programs. 



Definitions 



Implementation study - a process evaluation which provides 
information on policy implementation to policy makers and program 
personnel in order to allow adjustments to the implementation 
process prior to conducting a product or impact evaluation. 

Teacher evaluation - all policies and procedures directed to 
assessing the performance or competence of teaching personnel in 
elementary and secondary schools. 

Management and Finance Plan - a comprehensive program policy 
document prepared by the Alberta Department of Education to 
define policies and guidelines for financial and program 
initiatives of the Department of Education. 



o ' 22 

ERIC 



10 

Policy impact - changes in behavior or attitudes that result 
from policy initiatives (Dunn, 1981:280). 

Post-audit - refers to the process of holding school 
jurisdictions accountable for the results of educational 
expenditures within the context of the Management and Finance 
Plan of the Alberta Department of Education. 

Delimitations 

This study was delimited to tne province of Alberta, Canada. 
Further, the study was delimited to ascertaining the state of 
teacher evaluation policy implementation in 1986-87, through 
interviews with policy makers, administrators, and teachers in 
Alberta school jurisdictions, and analysis of jurisdiction-based 
policy documents and instruments used in evaluating teachers. 

Limitations and Assumptions 

The following limitations and assumptions apply to this 
study: 

The potential for interviewees to experience perceptual 
error and inaccuracy in describing teacher evaluation policy 
processes may limit the accuracy of the research. 

The Alberta Department of Education required school 
districts to have policy on teacher evaluation in place by June, 
1985; it was therefore assumed that the sampled jurisdictions 
have begun implementation of teacher evaluation policy and that 
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policy implementation has proceeded to a stage at which this 
study is warranted. 

Since only 90 policy implementors at 30 of 146 school 
jurisdiction sites were interviewed limitations due to sampling 
error are possible. 



o >:24 
ERIC 



CHAPTER TWO 



Review of Related Literature 

Introduction 

This literature review examines theoretical organizational 
processes having implications for teacher evaluation policy 
implementation, the general societal context of teacher 
evaluation in Alberta and recent studies of teacher evaluation 
processes* 

Organizational Theory and Teacher Evaluation 

The theoretical processes which Mintzberg (1979) and Meyer 
and Rowan (1978) discuss provide useful perspectives for 
assessing the political and bureaucratic aspects of teacher 
evaluation policy. Specifically, Mintzberg presents a 
conceptualization of the teaching profession which explains the 
capacity of the profession to resist change imposed exogenously, 
such as demands from a department of education for teacher 
evaluation. Meyer and Rowan introduce the concept of the "Logic 
of Confidence" which, similar to Mintzberg 1 s conceptualization, 
also explains how the teaching profession can successfully reaisit 
change. 

ERLC 
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The teaching profession can be described as a professional 
bureaucracy (Mintzberg, 1979). Professional bureaucracies are 
characterized by autonomy which Mintzberg (1579:371) suggests 
"allows the professionals to perfect their skills, free of 
interference. 11 This suggestion assumes that the professional 
accepts responsibility for self-directed skill development and 
that the aura of the professional bureaucracy is not eroded. Ar: 
inherent weakness of the profession*! bureaucracy lies in it* 
self-reliance for professional ethics. The crucial components of 
democracy and autonomy represent, according to Mintzberg 
(1979:372), . .all the major problems of the Professional 
Bureaucracy. 11 When there are few or no external controls on the 
work from outside the profession, there is also "no way to 
correct deficiencies that the professionals themselves choose to 
overlook." Professional discretion is a double edged sword 
which 11 . . .allows professionals to ignore needs of clients and 
the organization. 11 (Mintzberg, 1979:374). 

When the public and government perceive client needs as not 

being adequately served, Mintzberg (1979:376) suggests that 

problems are seen 

. . .as resulting from a lack of external control of 
the professional, and his profession, so they do 
the obvious: try to control the work with one of 
the coordinating mechanisms. Specifically, they 
try to use direct supervision, standardization of 
work processes, or . . .of outputs. 

Mintzberg (1979:377-378) argues that the nature of the 
professional bureaucracy makes attempts at external controls 
difficult. He argues that complex work cannot be effectively 
performed unless it is under the control of the professional who 
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performs it, and that "technocratic controls" lessen professional 

conscientiousness with the result that innovation can suffer. 

Rather than forcing external control on the professior al 

bureaucracy Mintzberg (1979:379) argues that other strategies 

might be more effective. Specifically, he states, 

• • .change seeps in by the slow process of 
changing the professionals - changing who can 
enter the profession, what they learn, • •and 
thereafter how willing they are to upgrade their 
skills, 

Mintzberg's conceptualization of the professional 
bureaucracy is an effective framework for describing the internal 
structures of the teaching profession and the interactions the 
profession establishes with its environment • The imperatives for 
teacher evaluation interact with the characteristics of freedom 
and autonomy which are inherent in the professional bureaucracy. 
Freedom and autonomy are necessary to carry out the work of the 
professional, but paradoxically, at the same time they create the 
space for error and abuse of responsibility to occur. 
Furthermore, the unique relationship between professional teacher 
and student do not submit well to standardization, thus making 
external evaluation a difficult process to establish with 
validity and reliability. 

The technical difficulties of creating effective teacher 

evaluation processes within a professional bureaucracy are also 

addressed by Strike and Millman (1983:397). They comment, 

But the central issues of designing an effective 
and functional system of evaluation concern how to 
embed technically respectable methods of 
evaluation into a complex social and institutional 
environment. 
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Strike and Millman (1983:390-393) suggest several questions 
relative to a research agenda on teacher evaluation. For 
example, research might address whether differences in the legal 
rights of tenured and non-tenured teachers are sufficient reasons 
for different evaluation practices between these two groups, in 
addition, what constraints do political considerations place on 
the technical aspects of teacher evaluation? Are teacher 
evaluation practices congruent with teacher views and teacher 
roles? And, what administrative structures are required relative 
to: administrative support, teacher involvement, an expertise 
base, and a generally recognized need for change in the teacher 
evaluation process? 

Authority in the professional bureaucracy is based on the 
power of expertise. Trust is placed in the professionals by 
clients, partially because of this perceived expertise, but 
organizational structures can also provide a basis for trust in 
professionals. Meyer and Rowan (1978:81) note that there is low 
control over the internal instructional activities in educational 
organizations because of the loosely coupled structure of 
schools. However, certain formal structures such as 
certification of teachers, allocation of funds, curriculum 
design, etc., are tightly organized. These tightly controlled 
formal structures are defined as "ritual classifications" by 
Keyer and Rowan (1978:95) which provide order for schools and 
provide an additional basis for trust in the professionals, 
Meyer and Rowan (1978:100) note that the ritual classification 
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structures are decoupled from the internal instructional 
activities of the school and that this 

. . . decoupling protects the ritual 
classification scheme . . .measuring what teachers 
are actually teaching introduces unnecessary 
uncertainty. . .and creates doubts about the 
effectiveness of . . .the categorical rules that 
define appropriate education. 

Meyer and Rowan (1978:101-102) suggest that this decoupling 

is a mechanism for maintaining support for the organization in a 

pluralistic environment and the "Logic of Confidence" created is 

a process for maintaining the legitimacy or trust placed in the 

organization itself. They conclude that 

The most visible aspect of the logic of confidence in the 
educational system is the myth of teacher professionalism 
[which] . . .helps to justify the confidence placed in 
teachers (Meyer and Rowan, 1978:102). 

Meyer and Rowan (1978) link the mythical aspects of 
professionalism to the logic of confidence which results from the 
decoupling of the formal, ritualistic classifications of the 
organization from the internal instructional operations of the 
school. This decoupling allows teacher professionals to operate 
in relative isolation from potentially critical environments. 
Kintzberg (1979), as discussed above, views professionalism as 
also based in bureaucratic structures such as standardization and 
decentralization, but links professionalism directly to the 
complex nature of the professional technologies. 

These two views are complementary. The logic of confidence 
placed in educational organizations helps to explain how 
professional bureaucracies can buffer themselves from their 
environments. Likewise, demands for external teacher evaluation 
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policies and accountability can be explained as an erosion of the 
logic of confidence. Teacher evaluation policies create changes 
to the ritual classification structures of the school; the 
internal processes are more closely coupled to the formal 
structures and the buffering capacity of the organization is 
lessened. Demands to couple formal, ritualistic classifications 
with the internal processes of schools result when the 
professionals fail to maintain their credibility, perhaps as a 
result of being buffered too completely, for too long. Teacher 
evaluation, mandated by governments is a logical consequence of 
such dynamics. 

Societal Contexts of Teacher Evaluation 

A rapidly changing social environment over the last two 
decades has created potent forces which have resulted in demands 
for policies addressing evaluation of school systems. 

Iannaccone (1977:282) argues that professionalism has 
"removed education from an arena with conflicting value systems 
and placed it in the realm of science." Assuming the development 
of disparate value bases between teacher professionals and 
external groups, the ultimate result of professionalism 
controlling the educational agenda may be an unavoidable conflict 
with groups in the external environment. The inevitable 
powerlessness external groups experience when professionals 
inside the organization control too many of the processes of 
education may create a power struggle. Iannaconne (1977:277) 
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suggests that "a fundamental source of tension. . .arises over the 
issue of the relative power of professionals and lay citizens 
over educational decisions." 

Educators and school boards may have been short-sighted in 
creating an aura of professionalism around schools and in not 
opening schools sufficiently to public input. Lutz (1977:59) 
cautions that "...in exercising power we must not only be aware 
of the immediate power outcomes but also of the effects that the 
patterning of power has on the future of the political system 
itself." Also, Mann (1977:91) warns that school boards are too 
insulated from their publics and that they essentially fail to 
represent the publics or to control schools with the result that 
the "task of representing the wishes and welfare of the public 
fall to the professional educators . . .[who] stress. . . 
professional autonomy, often at the expense of the communities 1 
expressed preferences." lannaconne (1977:271) discusses this 
phenomenon and argues that "privatization", or professionalism in 
this case, detaches the governing process from the political 
order or the environment. He suggests that no system can afford 
to be isolated when the environment is experiencing change. The 
costs of isolation can include reduced resources and lowered 
credibility. 

lannacone (1980:194) notes that the political environment in 
which educational organizations operate has changed in the past 
ten years. Consequently, the power relationship between the 
environment and educational organizations is undergoing change 
currently. Previously, there was an atmosphere of greater trust 
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in educational professionals. Policies mandating teacher 

evaluation demonstrate this trust deficit as well as the 

political dynamics of educational policy formulation. Iannacone 

(1980:207) states that, "policy flow is not simply hierarchical 

but represents the outcome of complex interactions among 

interdependent but separate structures of power and authority." 

Goodlad (cited in Housego and Downey, 1984:1) in his 

Blueprint for Reform argues that 

The province should set the expectations, the mandate for 
schools. It should ttr\i empower districts and schools to 
meet the expectations, and hold them accountable for doing 
so. 

In other words, provincial governments determine the ends 
and local jurisdictions determine the means. This prescription 
has some similarity to the Management and Finance Plan (MFP) and 
the related evaluation policies of Alberta Education. 

Iannacone (1980:205) suggests that policies (such as the 

MFP) are the result of interactions between sub-structures with 

divergent interests. He states that, 

. . .two aspects are critical. . .in any 
interpretation of legislative policy impact. One 
is the degree of independence found in local 
school districts, and tlie other is a "split within 
the local districts between the school 
board/central office level and the 
principal/teacher/student level of decision 
making. 

This observation has interesting implications for the 
resource dependency model of educational organizations (Weeres, 
1984:9) which specifies that organizational autonomy is linked to 
the degree of resource independence the organization enjoys, and 
for March's 1980 doctoral dissertation on the locus of control 
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over decision making between departments of education, central 
office level and school level decision making. March (1981; 209) 
found a trend toward centralization in Alberta, but coupled with 
increased control at the school level. He also observed that 
centralizing influences tended to be associated with factors 
external to educational organizations; such as, the political and 
economic climate, whereas decentralizing factors tended to be 
related to internal school operational matters. 

Paulston (cited in Papagiannis, 1982:246) provides further 
elaboration of the political nature of educational change; he 
notes that, "Ideology, power, and perceived group self-interest . 
. . [are] key factors influencing planning and implementation of 
basic educational reforms." 

Certainly, deeply rooted, basic and extensive imperatives 

for change have affected education in the past two decades. 

lannacone (1980:192) suggests that, "Research in the politics of 

education was largely stimulated by the increasing political 

controversies about education since the late 1950*3." lannacone 

(1980:204) cites declining student achievement scores and the 

observation that, "... policy makers began to recognize that 

the gap between policy making and implementing it was widening", 

as two key factors which destablized educational politics. He 

further suggests that the schools, 

. . . are in an era of pervasive and increasing 
political controversies. • .including their 
mission, structure of governance, instructional 
delivery systems and fundamental ideology 
(lannacone, 1980:194) . 
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A changing educational environment holds implications for 
teacher evaluation. Societal change has been popularized by 
Naisbitt (1984) who focused attention on societal shifts from an 
industrial to an information society characterized by a global 
economy, decentralization and networking. Ingram (1985:4-7) 
considers specific societal pressures for change in Alberta and 
notes increased diversity in school jurisdictions and school 
programming/ concerns for justice, tolerance and excellence, 
accountability and involvement as potential social forces in the 
province. Ingram (1985:10-12) observes that educational 
management has already been involved in one paradigm shift, from 
scientific management to a more humanistic model. Ingram 
(1985-19-23) suggests that recent review initiatives by the 
Department of Education ana the introduction of the Management 
and Finance Plan (MFP) are evidence of a "potential" new paradigm 
shift in educational management, but questions whether value 
bases have actually shifted sufficiently in Alberta to support a 
true paradigm shift. 

Recent Studies of Teacher Evaluation 

Duncan's (1984) study of teacher evaluation practices in 
Alberta indicated that respondents believed evaluation was a high 
priority, but felt that little time was available to carry it 
out. The majority of evaluations were done routinely to improve 
instruction, or to provide data to make decisions regarding 
permanent contracts or certification. However, a startling 
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finding was that only 4.5% met the minimum criteria for due 
process and only 1.3% met criteria for improvement of 
instruction. A follow-up study by Alberta Education (1985:1) 
concluded that H . . .formal evaluation practices by principals in 
Alberta did not change from 1983-84 to 1984-85." 

Townsend (1984) investigated implementation of teacher 
evaluation policies and practices in five Lethbridge, Alberta 
secondary schools involving 107 teachers and 16 administrators. 
Townsend (1984:20) noted that the time demand of supervision for 
administrators greatly exceeded expectations, which negatively 
affected impl mentation. Other inadequacies Townsend 
(1984:24-31) noted in his study include: 

-teacher rejection of evaluations done for administrative 

purposes ; 

-decline of teacher confidence in skills of evaluators; 
-information to teachers regarding process was lacking; 
-teacher training regarding evaluation purposes and process 
was insufficient; 

-administrative leadership with respect to evaluation was 
weak; 

-time demands were not met adequately; 

-district office support was felt to be inadequate; and, 
-divergent models of teacher evaluation were not considered. 
Mireau (1986:13), author of a set of teacher evaluation 

inservice materials sponsored by the Alberta Department of 

Education, comments 

The most frequent excuses for providing only a 
minimal amount of teaching supervision - or for 
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avoiding the task altogether - include lack of 
time and the risk of destroying good rapport with 
teachers. I think, however, that the basic reason 
is that we have a great deal to learn about 
recognizing and promoting effective teaching 
practices and about conferencing strategies which 
can pave the way to open, supportive, and 
practical feedback to teachers. 

These authors and their studies suggest that the state of 
teacher evaluation in Alberta may not be in a position to support 
comprehensive implementation of the policy initiatives of Alberta 
Education at the present time. Given a potential lack of 
evaluative expertise in the field, questions about the viability 
of a value based paradigm shift, and questions about the adequacy 
of model development and infrastructure preparation, teacher 
evaluation policy implementation in Alberta may experience 
barriers to successful implementation. 

Hickcox (1982:1) cites Scriven f s description of teacher 
evaluation as a "disaster" and makes the point that 

. . sound research on the topic, particularly on. . . 
implementing. . .has not had a high priority in the 
universities." Hickcox (1982:6) provides four recommendations 
with respect to teacher evaluation process: 

1) evaluation procedures should be cooperatively developed; 2) 
evaluation should be considered a continous process; 3) teachers 
should know in advance the steps to be followed, the appeal 
process and the judgement criteria; and 4) policies and 
procedures should be under continous review. 

Hickcox (1982:12) advances the Connecticut approach to 
teacher evaluation, which has some similarity to the Alberta 
approach, as a sound process. He states, 
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It is mandated that every school system in the state 
develop an evaluation system* While there are broad 
parameters, there is considerable flexibility. . .the system 
is monitored by an independent board consisting of 
representatives from various constituencies . . .the state 
provides funds to assist in the development of plans to 
provide in-service training. . .it was recognized that any 
real change will not occur without nurturing, training 
experiences and support. . .through cooperation between the 
state, the universities, and the teachers, the evaluation 
system itself is systematically evaluated, . .nothing is 
written in stone. 

Duckett (1985 :v) argues that it is apparent that many 
administrators are not comfortable in their new roles as 
systematic evaluators of teaching and that little in their 
academic background prepared them for rigorous, empirical 
evaluation of teachers. 

Manatt (1985:11-12) suggests the competent evaluator must 

know: 1) self, 2) elements of effective instruction, 3) clinical 

supervision, 4) how to develop a "use-tailored" teacher 

evaluation system, 5) how to infer, 6) conference techniques, 7) 

due process, 8) how to work with the marginal teacher, and 9) 

what teachers want from performance evaluation. Manatt 

(1985:13) further comments 

One presumes that principals, department heads, and 
supervisors would be well-acquainted with the research on 
teaching and techniques of clinical supervision. In the 
U.S. such is not the case generally. . . .Canada, 
incidentally is generally ahead of the United States in this 
regard. 

Manatt (1985:18-30) identifies a number of factors for 
successful teacher evaluation which can be linked to teacher 
evaluation policy implementation variables, including: attitudes 
or dispositons of iiaplementors toward evaluation, posturing by 
top executives as a motivator for principals, extensive 



37 



25 



inservicing, the power of sponsorship and modeling, participative 

planning without haste, rigorous training during the adoption 

year, clear communications to teachers regarding what is expected 

of them, and multiple classroom visits to every teacher every 

year. Manatt (1985:33) concludes, 

The foot draggers will say 'Yes-but-it takes too much time! 1 
. . .Ineffective schools take too much time, 13 years for 
your children and mine. Ineffective teachers cost too much. 
A 23 year-old teacher granted tenure despite his or her low 
quality teaching will cost a school well over a million 
dollars before he or she retires. Good performance 
appraisal doesn't cost, it Pays. 

Wise, et al (1985) conducted a comprehensive survey of 
teacher evaluation practices in 32 United States school districts 
and completed intensive case studies in four districts selected 
for their success in teacher evaluation implementation. Wise, et 
al (1985:63) discovered that generally, M . . .relatively few 
school districts have highly developed teacher evaluation systems 
and even fewer put the results into action. 11 

A critical perspective based in the wise, et al (1985) study 
is that the teacher evaluation policy selected for a school 
district must be finely tuned to that district's needs, purposes 
and context. Wise, et al (1985:65-66) propose four perspectives 
or theoretical frameworks for analyzing teacher evaluation: 1) 
teaching as 'labor 5 assumes effective teaching practices can be 
concretely determined and specified; 2) teaching as 'craft 1 
assumes general rules for applying specific techniques; 3) 
teaching as 'profession' assumes standards of professional 
knowledge and practice are enforced to assure competent teaching; 
and 4) teaching as 'art' assumes intuitive, creative, 
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improvisational teaching* Wise, et al (1985:93) suggest that 
these four perspectives may be thought of as a continuum, with 
each perspective requiring unique evaluation policies. Wise, et 
al (1985:66) contend that the teacher as artist perspective 
requires that the teacher exercise considerable autonomy in the 
performance of their work, a perspective closely resembling 
Mintzberg's conception of the professional bureaucracy, and that 
contextual variables increase in importance as one moves from 
teaching as labor to teaching as art. 

Wise, et al (1985:78) noted that the case study results from 
the four districts which had experienced successful teacher 
evaluation implementation suggested four critical implementation 
factors: 

1) top-level leadership and institutional 
resources for the evaluation process, 

2) evaluator expertise, 

3) administrator-teacher collaboration to develop 
a common understanding of teacher evaluation 
goals and purposes, and 

4) compatability with district overall goals and 
organizational context. 

These four factors may be universally necessary conditions 
for successful implementation of teacher evaluation policy, and 
they warrant further analysis within the context of the present 
study . 
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Summary 

A teacher evaluation policy implementation study can provide 
a timely and effective analysis of the implementation process. 
As evidenced in the above literature review, the translation of 
teacher evaluation policy intents to policy effects is neither 
direct nor simple. The process is based in political , 
bureaucratic and technical processes. Specific bureaucratic and 
technical structures may need to be in place before teacher 
evaluation policy can be successfully implemented. 



CHAPTER THREE 



Research Design and Methodology 

Introduction 

The research design and methodology, interview procedures, 
validity concerns and sampling procedures are discussed in 
Chapter Three. 

Research Design and Methodology 

This study is a descriptive survey or "case survey" (Dunn, 
1931:297) which involves procedures to identify and analyze 
factors that account for variations in the implementation of 
policies. This method requires the researcher to first develop a 
case coding scheme of categories that capture key components of 
policy inputs, processes, outputs or impacts. 

The information required for the study was secured through 
interviews and documents analysis. The first phase of the study 
is primarily qualitative, using semi -structured interviews of 
selected key decision makers and leaders in teacher evaluation in 
Alberta. Snowball sampling with key leaders and decision makers 
was used to identify a sample of these key individuals. That is, 
the first person interviewed, a former Minister of Education for 
Alberta, was asked to recommend others (Bogdan and Biklen, 
1982S66) . 
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Interview transcripts from phase I were typed and returned 
to interviewees who were asked to review the transcript for any 
errors or misinterpretations. Coding procedures recommended by 
Bogdan and Biklen (1982:158) guided the structure and analysis of 
the interview protocols. 

Questions which guided phase I interviews with key policy 
makers included the following: 

1. What process or chronology of events was important in 
affecting the adoption of teacher evaluation policy by the 
Department of Education? 

2. What process or chronology of events was important in 
affecting the implementation of teacher evaluation policy by the 
Department of Education? 

3. What key events may have affected the adoption of the 
current teacher evaluation activities in Alberta? 

4. What key events may have affected the implementation 
process in Alberta? 

5. What strategies, tactics, methods, or techniques were 
important for the adoption of teacher evaluation policy in 
Alberta? 

6. Were any social structures or informal networks 
significant in affecting the initiation, adoption or 
implementation process? 

7. Can you suggest any specific teacher evaluation policy 
materials to study, for example, documents, key correspondence, 
memos, studies, etc. 

8. What idealized policy, relationships, and goals would 
you hope for to enhance teacher evaluation policy implementation? 

9. What are your perceptions of the current status of 
teacher evaluation policy implementation? 

10. Who else might be a key decision maker, policy analyst 
or advisor that affected the teacher evaluation adoption or 
implementation process? 

11. How do you define the intents of teacher evaluation 
policy, including your world view (values) with respect to 
teacher evaluation? 



4.2, 



30 



A primary purpose of this phase was to identify the 
historical background , the purposes and intents of teacher 
evaluation policy visualized in th<> policy planning stage, and to 
determine the educational leaders 1 perceptions of the degree of 
implementation of teacher evaluation policy in the province of 
Alberta. 

Phase II Interview Schedules and Variable Clusters 

Three interview schedules were constructed to solicit 
responses from teachers / principals and superintendents or their 
designates regarding their perceptions of teacher evaluation 
policy implementation. Interview schedules (reproduced in 
Appendices A through C) were determined by findings from phase I 
interviews with policy makers and by the variable clusters 
identified by Van Horn and Van Meter (1977) • 

Validity Concerns 

All phase I interview respondents were asked to review typed 
copies of the interview transcript and to correct any errors of 
interpretation which might have been committed by the researcher. 

Initial drafts of the phase II interview schedules were 
reviewed by two doctoral students and three professors in the 
Department of Educational Administration at the University of 
Alberta for face validity. The second draft versions of the 
interview schedules were then subjected to pilot testing in the 



31 



field through simulated interviews with two assistant 
superintendents, two principals and two teachers. This pilot 
testing was intended to eliminate any terms which were vague or 
ambiguous, and to elicit respondents perceptions of the degree of 
comprehensiveness represented by the interview schedules relative 
to teacher evaluation policy implementation. Final adjustments 
were made to the interview schedules based on the pilot 
interviews and these revised interview schedules were used in 
conducting phase II interviews. The interview schedules are 
presented in Appendices A through C. 

Phase II interviewees were assured of anonymity and were not 
asked to review interview transcripts. During the phase II 
interviews if any confusion or ambiguity seemed to be present in 
relation to any of the responses given during the interview, the 
researcher confirmed the interviewee's intentions at the 
interview itself. 

The f ield-based structured interviews permitted the 
researcher to experience more in-depth analysis of teacher 
evaluation policy implementation with practitioners in the field 
than would have been possible through survey research 
methodology. 

Phase II interpretation involved a qualitative analysis of 
the interviews with policy implementors in the field to identify 
themes and patterns of responses in relationship to the Van Horn 
and Van Meter (1977) policy implementation model. 
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Sampling Procedure 

Thirty of 146 active Alberta school jurisdictions were 
randomly selected from the Alberta School Jurisdiction List, 1986 
for inclusion in this study. In order to assure a representative 
sample of jurisdictions, the population of jurisdictions was 
stratified on the basis of type of jurisdiction (county, public 
school districts, separate school districts, regional school 
districts or Department of National Defense schools, and school 
divisions) and geographic zone (1 through 6) . Jurisdictions were 
then selected from each stratified grouping using a random 
numbers table. 

Letters requesting each jurisdiction's participation in the 
study were posted on September 5, 1986. A copy of this 
correspondence is presented in Appendix D. Five of the thirty 
jurisdictions initially contacted declined involvement in the 
study on the basis cf over- involvement with research studies or 
simply being too busy to participate. Alternative jurisdictions 
randomly selected within the same stratified grouping were 
subsequently contacted and all agreed to participate. The ninety 
phase II interviews began on October 28, 1986 and were completed 
on February 23, 1987. 

The breakdown, by zone and type, of the jurisdictions which 
participated in the study appears in Table 1. 
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Table 1 

Distribution of Participating Jurisdictions by Zone and 

Type of Jurisdiction 



Zone 


One 


Two 


Three 


Four 


Five 


Six 


TyP e 
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County 


1 


1 


1 


1 


1 


1 


Public 


1 


1 


1 


1 


1 


1 


Division 


1 


1 


1 


1 


1 


1 


Separate 


1 


1 


2 


2 


0 


1 


Regional 


0 


1 


0 


0 


0 


0 



School district teacher evaluation policy documents, 
obtained from each sampled jurisdiction, were studied using a 
content analysis procedure. In addition, school administrators 
interviewed were asked for copies of teacher evaluation 
instruments (recording/reporting forms) in use in their 
jurisdiction. A content analysis of these instruments was 
completed and is reported in Chapter Eight. 

Summary 

The research design and methodology, interview procedures, 
validity concerns and sampling procedures were delineated in 
Chapter Three. The study was described as primarily a 
qualitative study intended to explore themes and trends relative 
to teacher evaluation policy implementation in Alberta. 
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Interview structures and procedures used in phase I interviews 
with policy makers and phase II interviews with policy 
implement or s were defined and discussed. Actions taken to 
address concerns regarding validity were presented and the 
snowball sampling procedures used to select phase I respondents 
and the stratified random sampling procedures used to select 
phase II respondents were detailed. 
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CHAPTER FOUR 

Conditions Affecting Policy Adoption and Implementation 
Introduction 

Chapter four consists of the analysis of phase I interview 
results with the policy makers who were influential in the 
adoption and implementation of teacher evaluation policy in 
Alberta. A central purpose of this chapter is to establish the 
policy intents and the background to teacher eval\iation policy 
development in Alberta. The following questions and 
sub-questions are addressed in Chapter Four. 

1. What events affected teacher evaluation policy adoption 
and implementation in Alberta? 

a. What were the policy intents held by the policy 

makers? 

b. What social structures or informal networks 
affected the policy process? 

c. What were the anticipated ideal policy intents of 
the policy makers? 

d. What were the perceptions of policy makers of the 
current status and possible future outcomes of teacher evaluation 
policy? 
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Interview Targets and Structure 

The background to the teacher evaluation policy initative in 
Alberta was explored through interviews with key policy makers, 
including Mr. David King, the former Minister of Education whose 
term of office encompassed the development of current teacher 
evaluation policy. In addition, Mr. King was asked to identify 
individuals who had had an influence on him or who played a key 
role in the development of teacher evaluation policy by the 
Alberta Department of Education. These individuals and their 
position at the time of interview included: Dr. E. Hawkesworth, 
former Deputy Minister of Education in Alberta; Dr. N. Hrynyk, 
former Associate Executive Secretary, the Alberta Teachers 
Association; Dr. R. Bosetti, Deputy Minister of Education, 
Alberta Education; Dr. J. Hrabi, Assistant Deputy Minister, 
Planning and Evaluation Division, Alberta Education; Dr. S. 
Odynak, Assistant Deputy Minister, Program Delivery Division, 
Alberta Education; Dr. M. Fenske, Assistant Deputy Minister, 
Program Development Division, Alberta Education; and Dr. W.R. 
Duke, Assistant Deputy Minister, Finance Division, Alberta 
Education. In addition, Mr. Gary Zatko, Associate Director, 
Planning Services, Alberta Education was subsequently identified 
as a key policy resource person who was included in the 
interviews with policy makers. 

The interviews, conducted during the period June 20 to 
September 10, 1986, were structured according to analytical 
categories suggested by Bogdan and Biklen (1982:158). The 
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analytical categories were used a priori to identify potentially 
important information categories. 

Questions included the following categories: the respondents 
general definition or world view of teacher evaluation? events 
which affected the adoption of teacher evaluation policy 
development in Alberta; events which affected the implementation 
of teacher evaluation policy at the provincial level; social 
structures or informal networks which were significant relative 
to teacher evaluation policy adoption and implementation; the 
idealized teacher evaluation policy functions and goals; 
perceptions of the current extent of teacher evaluation policy 
implementation and possible future outcomes which may occur given . 
current trends. 

Eve nts Affecting Teacher Evaluation Policy Adoption 

Teacher evaluation policy adoption by senior management in 
the Alberta Department of Education can be characterized as an 
evolutionary response to a series of evancs over a period of 
approximately 16 years, dating from the introduction of locally 
appointed superintendents in 1971. 

Respondents indicated a high degree of concensus regarding 
several factors which affected the adoption of teacher evaluation 
policy by the Alberta Department of Education, including: 

1) the Teaching Professions Act negotiations 
breakdown ; 

2) the general absense of routine teacher 
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evaluation under locally appointed 
superintendents ; 

3) the perceived need for improvement in the 
quality of instruction and diffuse 
environmental demands for accountability; 

4) specific concerns regarding the need for 
teacher evaluation by the Premier and caucus; 

5) the opportunity of linking teacher evaluation 
to a policy driven, post-audit program thrust 
by the Department of Education; 

6) the logical connection between policy 
implementation of student evaluation and the 
need for concommitant teacher evaluation 
policy; 

7) lack of action on teacher evaluation by the 
Alberta Teachers' Association or local 
jurisdictions; and, 

8) concensus among senior management in the Department 
of Education regarding the policy directions 
necessary in response to the abova. 

These eight factors are explicated further* One respondents 
contention that the former Minister of Education did not 
understand the Alberta Teachers 1 Association (ATA) suggests the 
Teaching Professions Act (TPA) negotiations may have been 
effected by a poor relationship between the Minister and the ATA. 
When negotiations on the TPA between Alberta Education and the 
Alberta Teachers 1 Association became blocked, the Minister of 
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Education stated that it was necessary to proceed unilaterally 
with the development of the Council on Alberta Teaching Standards 
(COATS) . These developments negatively affected the development 
of teacher evaluation policy through reduced trust between the 
Alberta Teachers 1 Association and the Minister, and by extension, 
the Department of Education. 

The long term perception of senior management within the 
Department of Education that teacher evaluation was not occurring 
adequately under locally appointed superintendents was confirmed 
through both independent study and Department surveys (Reikie, 
1977) and (Duncan, 1984) . 

Documentation of the Department of Education f s early 

concerns regarding teacher evaluation can be found in a January 

30, 1980 letter from Dr. E. Hawkesworth, former Deputy Minister, 

to Alberta school system superintendents. In the letter, 

Hawkesworth summarized the outcomes of a Canadian Education 

Association seminar on inservice and retraining of teachers and 

administrators which included representatives from educational 

sectors across Canada. In the letter, which is reproduced in 

Appendix E, Hawkesworth commented, 

. . .a major barrier to providing adequate professional 
development programs for teachers and administrators is the 
lack of comprehensive ongoing evaluation programs for 
them. ... 

If the situation as outlined pertains in Alberta school 
systems also, then improvement in personnel management 
procedures is essential. 

This conrern over teacher evaluation procedures addressed in 
early 1980, when linked with the common experiences of senior 
management staff as former Department appointed school inspectors 
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or superintendents, appears to have been a particularly important 

factor which facilitated adoption of teacher evaluation policy by 

the Department of Education* 

Environmental pressure on the Department was consistently 

described as diffuse, but related to concerns over the need for 

accountability and improvement of instruction. In a subsequent 

telephone interview with Mr. King on January 5, 1987, the former 

Kinister of Education was asked specifically about the nature of 

environmental or political pressures for teacher evaluation which 

he felt as minister. He responded, 

The political pressure, to the extent I felt it, came from 
fellow MLA 1 s, from the media, and the general public. Most 
was not direct on [the] point of teacher evaluation, most 
was rather in [the] form of expressed frustration about 
something that had gone wrong with a specific teacher at the 
center of it? the Keegstra incident, f example. Teacher 
evaluation wasn f t a direct request; moi>* a questioning and 
frustration process. [It was] more a matter of us 
concluding that teacher evaluation was a potential solution 
to the problem. 

Environmental pressures were also translated through 

formal provincial political channels. Both Deputy Ministers 

interviewed noted the influence of the Premier, and the former 

Minister stated that "Teacher evaluation was one of the specifics 

tiiat represented a high level of interest in the caucus and with 

the premier" (D. King, personal communication, January 5, 1987). 

Essentially then, the environmental pressures from the grass 

roots level was general or diffuse, but was translated through 

the caucus and the premier as a more pointed and specific demand 

for formal teacher evaluation policy. 

Complementary to pressures on the Department for teacher 

evaluation policy was an internal thrust within the Department 
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for a policy driven, post-audit management and finance plan which 

vould structure and guide the programs of the Department of 

Education, Consequently, evaluation policies, whose initiative 

proceeded the Management and Finance Plan (MFP) ultimately became 

an integral component of the MFP. Both were meant to be 

outcomes-oriented with an emphasis on ends-versus-means with 

Alberta Education's primary role in articulating ends which were 

drawn out by the political process operating within the 

provincial community. 

The logical connection between student evaluation policy and 

teacher evaluation policy is underscored by the political 

connections* Tymko (1979:237) investigated the accreditation of 

Alberta high schools issue and noted, 

The Premier of Alberta addressed tfc.e Canadian Education 
Association and indicated the problem of quality in 
education will result (in Alberta at least) in strong public 
demand for some form of province-wide testing. 

The concerns which Mr. King noted that were held by the 
caucus and the premier regarding teacher evaluation were 
apparently intimately linked to perceptions of need for student 
evaluation. This linkage is reflected in the importance given 
these two policy thrusts by the Alberta Department of Education. 

One respondent noted the lack of a proactive stance with 
respect to teacher evaluation by the Alberta Teachers 1 
Association and local jurisdictions. This perpsective coincides: 
with the point of view of senior management within the Department 
of Education regarding relative inaction Ly school jurisdictions. 
Essentially, in the absense of any action in the field and with 
distinct pressures for teacher evaluation, the Department had no 
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option but to act as the policy catalyst with respect to teacher 
evaluation policy adoption. 

Lastly, teacher evaluation policy adoption was facilitated 
by the shared perspectives and experiences of senior management 
as Department appointed school inspectors or superintendents, and 
resultant consensus regarding adoption of teacher evaluation 
policy among these senior policy makers in the Department of 
Education. 

Events Affecting Teacher Evaluation Policy Implementation 

Teacher evaluation policy implementation was strongly 
affected by a specific environmental event, the Keegstra affair, 
and by the internal development of the Management and Finance 
Plan of the Alberta Department of Education. Jim 
Keegstra was an Alberta Social Studies teacher who was dismissed 
in January, 1983 for teaching unauthorized curriculum based on 
Jewish conspiracy theory (David, 1983:21). The dismissal and 
subsequent de-certification of Mr. Keegstra generated intensive 
media scrutiny over a period of many months. 

Most interviewees perceived the Keegstra affair as a catalyst 
to implementation of teacher evaluation policy in terms of 
limiting the potential resistance of the Alberta Teachers 1 
Association, and in keeping public awareness of the issue high. 
However, it is interesting to note that the former Minister of 
Education commented on the potential negative effect of the 
Keegstra affair with respect to its limiting opportunity for 
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teacher input into the policy development process at the local 
jurisdictional level. 

The Keegstra affair represents a classic example of how an 
extraneous, environmental ev*r>t can dramatically affect the 
policy implementation process. 

The Management and Finance Plan of the Alberta Department of 
Education represents an important teacher evaluation policy 
implementation vehicle. The high visibility of the MFP, and the 
commitment to it by senior management in the Department, coupled 
with the requirement of teacher evaluation policy implementation 
by local jurisdictions as a pre-requisite for funding, resulted 
in the interviewees perceiving it as a powerful implementation 
instrument. 

Other factors which were see:a by the policy makers as 
affecting the implementation process included: 

1) the Alberta Teachers 1 Association position on 
formative and summative evaluation as a barrier 
to implementation; 

2) the Departments requirement of teacher evaluation 
policy approval which served as a potential source 
of misunderstanding; 

3) the under-suppiy of staff skilled in teacher 
evaluation; 

4) the effect of role shifts from consulting to 
monitoring in the Regional Offices of Education; 

5) the support of the Alberta School Trustees 1 
Association and the Council of Alberta School 
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Superintendents ; 

6) the difficulty of the appeal process in small 
jurisdictions; 

7) the visible and practical support of the Mireau 
inservice materials; and, 

8) the former Minister of Educations interest in 
evaluation in educational systems. 

These points are elaborated further. The Alberta Teachers 1 
Association was perceived by most interviewees as a barrier to 
implementation in terms of its insistence that formative and 
summative functions of evaluation must be separate, and in terms 
of its general organizational role. 

Teacher evaluation policy was the only evaluation policy 
that had to be approved by the Department of Education. While 
this policy standard was meant to facilitate the implementation 
process, it apparently in some cases caused some misunderstanding 
regarding the role of the Department in the policy development 
process, or resistance to the requirement by policy implementors. 

Concerns regarding the undersupply of skilled evaluative 
staff, role shifts from consultation to evaluation by the 
Regional Offices, and problems with appeal processes in small 
jurisdictions were mentioned by only one or two interviewees, but 
provide useful points of comparison with the characteristics of 
the implementing agency, communications, and resources variables 
of the Van Horn and Van Meter (1977) policy implementation model. 

Likewise, ASTA and CASS support for teacher evaluation 
policy, the Mireau teacher evaluation inservice materials 



-57 



45 



developed by the Department of Education in support of teacher 
evaluation initiatives, and Mr. King's ongoing interest in 
evaluation were mentioned by one interviewee, but these themes 
are relevant to the policy implementation model used in the 
study. 

Policy Intents of Teacher Evaluation 

King, the former Minister of Education, identified teacher 
evaluation as an early priority of his portfolio. He viewed 
teacher evaluation as encompassing both self -evaluation and 
external-evaluation components, with both types focusing on 
improvement of teacher performance. 

Among senior management in the Department of Education, 
there existed a high degree of concensus regarding the intents of 
teacher evaluation policy. All respondents within the Department 
concurred with the focus on improvement of instruction, while 
many saw it as a mechanism to improve teacher professionalism. 
One Assistant Deputy Minister saw it as a means of demonstrating 
accountability to the public. The perspectives of the senior 
management within the Alberta Department of Education was 
congruent with the former Minister of Education's views. 

Social Structures or Informal Networks 

Informal networks or their absense appear to have played an 
important role in the development of teacher evaluation policy in 
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Alberta. Specif icaJ.Xy, informal contacts with the Alberta School 
Trustees 9 Association (ASTA) provided for better communications 
between the Department of Education and that body. The absence 
of informal communication mechanisms between the Department and 
the Alberta Teachers 1 Association (ATA) may have exacerbated the 
tensions between thp ATA and Department with respect to teacher 
evaluation policy development. 

Idealized Policy Intents 

Ideally, under conditions of successful implementation, Mr, 
King indicated that he viewed teacher evaluation as accomplishing 
four goals: 1) elimination of incompetent teaching, 2) 
improvement of the act of teaching, 3) improvement of the overall 
quality of teaching, and 4) contributing to increased public 
confidence in the educational system. 

Interviews with policy makers indicated that ideal policy 
intents and requirements needed to enhance implementation of 
teacher evaluation policy would include: 

1) more effective personnel resources; 

2) better liaison with the Alberta Teachers 8 
Association and universities regarding support 
structures; 

3) institutionalization of teacher evaluation with 
evaluation seen as a need versus a threat; 

4) increased resources, especially in small 
jurisdictions; 
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5) more research and development on teacher 
evaluation processes; and, 

6) r* clear focus on the improvement of teaching 
and resultant student learning. 

Current Status and Possible Future Outcomes 

Teacher evaluation policies were in place locally in 1985. 
The former Minister of Education stated that he did not know the 
implementation situation currently, but as of last year some 
boards were doing well and others badly. Teacher evaluation 
cannot be successful in the long term, Mr. King stated, unless 
teachers are committed to the value of it and are involved in 
designing and operating the process. This scenario would likely 
develop through an evolutionary process. 

Ultimately, teacher evaluation policy will be sucessfully 
implemented, Mr. King suggested, for four reasons. First, the 
process has passed from politicians to the grass roots level. 
Consequently, the level of conflict will be reduced and 
cooperative, successful local models will . evolve and be emulated. 
Second, younger professionals entering teaching will bring new 
ideas regarding the value and role of management and evaluation 
in education. Third, teacher evaluation is necessary for the 
health of the profession. Fourth, the public now expects teacher 
evaluation as an aspect of the educational system, and both the 
government and the teaching profession have a stake in the 
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successful implementation of teacher evaluation policy in order 
to improve and maintain the public's confidence in education. 

The policy makers interviewed did not believe teacher 
evaluation policy initiatives will dissipate; however, they also 
did not think that implementation is anywhere near complete. 

The future will likely require the creation of mechanisms 
that will provide for more teacher involvement in the evolution 
of teacher evaluation processes in Alberta. In addition, the 
expertise base and resources in support of teacher evaluation 
will need enhancement. Court cases quest ionning the expertise of 
evaluators and collective agreement negotiations focusing on 
teacher evaluation procedures might also be future forces shaping 
teacher evaluation in the province. 

Summary and Conclusions 

Phase I interview results with the policy makers who were 
influential in the adoption and implementation of teacher 
evaluation policy in Alberta were presented in Chapter Four. A 
central purpose of this chapter has been to establish the policy 
intents and the* background to teacher evaluation policy 
development in Alberta. 

The following questions and sub-questions were addressed in 
Chapter Four. 

1. What events affected teacher evaluation policy adoption 
and implementation in Alberta? 
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a. What were the policy intents held by the pol* *y 

makers? 

b. What social structures or informal networks 
affected the policy process? 

c. What were the anticipated ideal policy intents of 
the policy makers? 

d. What were the perceptions of policy makers of the 
current status and possible future outcomes of teacher evaluation 
policy? 

Among senior management in the Department of Education, 
there existed a high degree of concensus regarding the intents of 
teacher evaluation policy. 

Teacher evaluation policy adoption in Alberta was based on a 
complex interplay of forces dating back to the early 1970' s. 
Policy makers indicated a high degree of concensus regarding 
several factors which affected the adoption of teacher evaluation 
policy by the Alberta Department of Education, including: 

1) the breakdown in the Teaching Professions Act 
negotiations between the Department of Education 
and the Alberta Teachers' Association; 

2) the general ab sense of routine teacher 
evaluation under locally appointed 
superintendents ; 

3) diffuse environmental demands for accountability 
related to concerns over the need for improvement 
of instruction; 

4) specific concerns regarding the need for 
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teacher evaluation by the provincial premier and the 
caucus of the Provincial Legislature; 

5) the opportunity of linking teacher evaluation 
to a policy driven, comprehensive monitoring 
initiative by the Department of Education; 

6) the logical connection between policy 
implementation of student and teacher evaluation as 
accountability mechanisms; 

7) iiisufficient action on teacher evaluation by the 
Alberta Teachers 1 Association and by local school 
j ur isdict ions ; and , 

8) concensus among senior management personnel in the 
Department of Education regarding the policy 
directions necessary for teacher evaluation policy 
adoption. 

Teacher Evaluation policy implementation is perceived to 
have been strongly affected by the Keegstra affair by policy 
makers who saw the incident acting as a catalyst to policy 
implementation. Also, the advent of the Department of 
Education's Management and Finance Plan served as a timely and 
effective implementation vehicle in support of teacher evaluation 
policy, other factors which were seen as affecting the 
implementation process included: 

1) the Alberta Teachers 1 Association position on 
formative and summative evaluation as a barrier to 
implementation; 

2) the requirement that each local jurisdictions 
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teacher evaluation policy be approved by the Alberta 
Department of Education as a potential source of 
misunderstanding; 

3) the unJer-supply of staff skilled in teacher 
evaluation; 

4) the effect of role shifts from consulting to 
monitoring in the Regional Offices of Education; 

5) the support of the Alberta School Trustees 1 
Association and the Council of Alberta School 
Superintendents ; 

6) the difficulty of the appeal process in small 
jurisdictions; 

7) the visible and practical support of the Mireau 
inservice materials; and, 

8) the former Minister of Education's interest in 
evaluation in educational systems. 

Informal networks or their absense appear to have played an 
important rol ■ in the development of teacher evaluation policy in 
Alberta. Specifically, informal contacts with the Alberta School 
Trustees 1 Association provided for better communications between 
the Department of Education and that body. The absence of 
informal communication mechanisms between the Department and the 
Alberta Teachers 1 Association may have exacerbated the tensions 
between the ATA and Department with respect to teacher evaluation 
policy development. 

Ideal policy intents and requirements needed to enhance 
iaiplemenation of teacher evaluation policy included: 



64 



52 



1) more effective personnel resources; 

2) better liaison with the Alberta Teachers 1 
Association and universities regarding support 
structures; 

3) institutionalization of teacher evaluation with 
evaluation seen as a need versus a threat; 

4) increased resources, especially in small 
jurisdictions; 

5) more research and development on teacher 
evaluation processes; and, 

6) a clear focus on the improvement of teaching 
and resultant student learning. 

Policy makers did not believe teacher evaluation policy 
initiatives will dissipate; however, they also did not think that 
implementation is anywhere near complete. 
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CHAPTER FIVE 
Policy Intents, Standards and Resources 

Introduction 

Phase II interview results with teacher evaluation policy 
implementors are presented in Chapter Five. The research 
problems addressed in this chapter include: 

What were the perceived policy intents held by policy 
Amplementors and were perceptions of intents between policy 
makers and impleuentors congruent? 

To what degree have policy standards and resources affected 
teacher evaluation policy implementation (Van Horn and Van Meter, 
1977)? 

Also addressed in Chapter Five are the general impressions 
of policy implementors. 

Policy Intents at the Provincial Level 

Two questions were asked of teachers, principals and 
superintendents regarding the intents of teacher evaluation 
policy: 

1. What do you believe are the purposes of the teacher 
evaluation policy at the provincial level; and, 
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2. What, in your opinion, are the purposes of your 
jurisdiction's teacher evaluation policy? 

Interviews with policy makers revealed that among senior 
management in the Department of Education, there existed a high 
degree of concensus regarding the intents of teacher evaluation. 
All respondents within the Department concurred with the focus on 
improvement of instruction, while many saw it as a mechanism to 
improve teacher professionalism. One Assistant Deputy Minister 
saw it as a means of demonstrating accountability to the public. 

Teacher evaluation policy adoption by senior management in 
the Alberta Department of Education was largely an evolutionary 
response to a series of events over a period of approximately 16 
years, dating from the introduction of locally appointed 
superintendents in 1971. 

Policy makers indicated a high degree of concensus regarding 
several factors which facilitated the adoption of teacher 
evaluation policy by the Alberta Department of Education, 
including: 

1) the Teaching Professions Act negotiations 
breakdown; 

2) the general absense of routine teacher 
evaluation under locally appointed 
superintendents ; 

3) the perceived need for improvement in the 
quality of instruction and diffuse 
environmental demands for accountability; 

4) specific concerns regarding the need for 
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teacher evaluation by the Premier and caucus; 

5) the opportunity of linking teacher evaluation 
to a policy driven, post-audit program thrust 
by the Department of Education; 

6) *3ie logical connection between policy 
implementation of student evaluation and the 
need for concommitant teacher evaluation 
policy; 

7) lack of action on teacher evaluation by the 
Alberta Teachers 1 Association or local 
jurisdictions; and, 

8) concensus among senior management in the Department 

of Education regarding the policy directions necessary 
in response to the above „ 

Relative to the question regarding policy intents at the 
provincial level, the content analysis of phase II interviewee 
responses identified eleven response categories, which are 
summarized in Table 2. 

Each interviewee may have indicated more than one response; 
therefore ; total responses exceed the number of interviewees. 
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Table 2 

Phase II Respondent Identified Provincial Level 

Policy Intents 



Response 


Tchrs. Prins. 


Suets . 


Total 


Demonstrate accountability 

to the public 11 


15 


19 

Jl-7 




Improve teaching 
methods 


8 




12 




Response to Keegstra 


9 


8 


4 


21 


Political reaction 
by the DOE 


6 


10 


5 


21 


Assure uniformity of 
evaluation standards 


5 


5 


7 


17 


Monitor and improve 




4 


5 


14 


Assure curricular 
standards 


8 


3 


1 


12 


Response to absence 
of evaluation 


4 


0 


0 


4 


Back-up permanent 
certification process 


2 


0 


0 


2 


Enhance professional 
status of teaching 


1 


0 


0 


1 


Improve classroom 
discipline 


1 


0 


0 


1 


note : Tchrs . ^Teachers , Pr ins . 


=Principals / 


Supt.i 


=Superintendents . 



The most common response for teachers, principals and 
superintendents was demonstration of accountability to the 
public. Although this intent was identified by policy makers as 
a reason for policy adoption, they did not identify it as a 
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primary policy intent, nor is it identified as such in the 
provincial policy manual. Half of the policy implementors, 
however , perceive accountability as the primary purpose or intent 
of teacher evaluation policy at the provincial level. 

The second most frequent response overall was improvement of 
teaching methods, with principals and superintendents citing this 
purpose more often than teachers. This purpose is highly 
congruent with both the responses of policy makers in Phase I 
interviews and with provincial policy documents (Alberta 
Education, 1984b) . 

The third and fourth most frequent responses are both -highly 
political in nature. Response to the Keegstra affair and 
political reaction by the Department of Education were both cited 
by 21 of the 90 respondents. The reference to Keegstra might be 
considered a specific example of a political response. Policy 
makers identifed grass roots political pressure as diffuse, but 
distinct political pressure was felt from the provincial 
legislature. Political pressure was seen by policy makers as a 
factor a. acting adoption of policy, but is not a stated intent 
of provincial policy. The Keegstra affair was identified by 
policy makers as a key factor in the implementation of teacher 
evaluation policy in Alberta, but clearly was not an issue in the 
policy adoption stage. However, 21 respondents, including 9 
teachers perceive the Keegstra affair as a factor affecting the 
purposes or intents of provincial teacher evaluation policy. 
This misperception of provincial policy intents by policy' 
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implementors might result in misunderstanding and resistance to 
teacher evaluation policy by implementors. 

The next three response categories 11 assure uniformity of 
evaluation standards, monitor and improve teacher proficiency, 
and assure curricular standards" were mentioned by 17, 14 and 12 
of the 90 respondents respectively. These three response 
categories are largely congruent with provincial policy intents 
or factors affecting adoption of policy as defined by policy 
makers. 

The last four response categories "response to absense of 
evaluation, back-up permanent certification process, enhance 
professional status of teaching, and improve classroom 
discipline" were mentioned infrequently, and hence are not major 
factors from the perspective of policy implementors. It is 
significant, however, that the response category, "enhance the 
professional status of teaching", which is a stated objective of 
provincial policy (Alberta Education, 1984b) , was mentioned by 
only one respondent, a teacher. The lack of recognition of this 
policy intent by policy implementors suggests the need for more 
adequate communication and support of this intent by policy 
makers . 

Policy Intents at the Jurisdictional Level 

All three phase II respondent levels, teachers, principals, 
and superintendents, were asked for their opinion of the purposes 
of their jurisdictions 1 teacher evaluation policy. Responses to 
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this question are summarized in Table 3. Each interviewee may 
have indicated more than one response; therefore, total responses 
exceed the number of interviewees. 

Table 3 

Phase II Respondent Identified Jurisdictional Level 

Policy Intents 

Response Tchrs. Prins. Supts. Total 

Improve teacher 
performance; Improve 

educational quality 21 24 29 74 

Board concern 

regarding accountability 10 4 10 24 

Personnel decision 

making 1 9 13 23 

Compliance with 

Department requirements 6 6 2 14 

Recognize or reward 

dedicated teachers l 4 6 11 

Maintain curricular 

standards 4 2 2 8 

Assure teacher evaluation 

standards; consistency 0 2 0 2 

Assure evaluation 

occurs 1.0 0 1 

Response to 

the Keegstra affair 1 0 0 1 

Assess inservice needs 0 10 1 

Enhance professional 

status of teaching 0 0 1 1 

Assist in the planning 

process 0 Oil 



Note: Tchrs. teachers, Prins. ^Principals, Supt. Superintendents, 
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By far, the mont frequent purpose of teacher evaluation 
policy identified at the jurisdictional level was improvement of 
teacher performance or educational quality, with 74 of 90 
respondents noting this intent. This compares to 33 respondents 
who cited the same intent at the provincial level. A significant 
translation of policy intent from the provincial to the 
jurisdiction level appears to have occurred in the perception of 
policy implementors. The translated jurisdictional policy intent 
is consistent with stated provincial policy, but does point out a 
lack of congruence with perceived policy intent at the pro\xncial 
level • 

Board concern over accountability was noted by 24 
respondents and was the second most frequent response which 
compares to the accountability concern being first relative to 
the perception of provincial policy intents. However, it is 
noteworthy that only one respondent perceived the board's teacher 
evaluation policy to be a response to the Keegstra affair, 
whereas 21 respondents made this connection regarding provincial 
policy intents. 

Personnel decision making was seen as an important intent of 
jurisdictional teacher evaluation policy, primarily by 
administrative staff with only one of the 23 respondents who 
identified this intent being a teacher. 

An additional imbalance between teacher and administrative 
respondents is apparent with respect to the purpose of 
recognizing or rewarding dedicated teachers, with ten of the 
eleven respondents being administrators. 
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The absense of a perception of teacher evaluation policy 
having the intent of enhancing the teaching profession, noted at 
the provincial policy level, was also identified as minimal at 
the jurisdictional level, with only one respondent again 
suggesting this purpose. . 

The consistent absence of this policy intent from the 
perspective of policy implementors suggests an important 
discrepancy between the intents of the policy makers and the 
perception of that intent by the policy implementors. 

The remaining response categories noted in Table 3 were 
mentioned infrequently, and are not major factors from the 
perspective of policy implementors. 

P olicy Intents - A Summary 

Overall, the policy implementors in the field perceive the 
purposes or intents of teacher evaluation at the provincial level 
largely as a demonstration of accountability or a Department of 
Education response to political events. One third of the 
respondents did perceive the intent of improving teaching; 
however, only one respondent identified enhancement of the 
teaching profession as an intent of provincial policy. 

On the other hand, 74 respondents linked improvement of 
teaching as a policy intent at the jurisdictional level, 
suggesting that a translation of this policy intent between 
organizational levels; has occurred. Essentially, implementors 
perceive teacher evaluation policy at the provincial level to 
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have a summative emphasis, and at the jurisdictional level to 
have a formative emphasis. 

The enhancement of the professional status of teaching as a 
policy intent was also absent at the jurisdictional level, since 
". . .professional growth and development of teachers." (Alberta 
Education, 1984bJ72) is a stated intent of provincial teacher 
evaluation policy, the almost complete absence of this policy 
intent in the perception of policy implementors warrants careful 
consideration by both policy makers and policy implementors. 

Policy standard s 

Van Horn and Van Meter (1977:107) define policy standards as 
policy inputs which ». . .establish requirements, in varying 
degrees of specificity, for how those [policy] goals shall be 
implemented." In the case of the provincially initiated teacher 
evaluation policy, the absence of policy standards is noteworthy. 
Local jurisdictions were given a large degree of flexibility and 
were encouraged to develop their own local policies on teacher 
evaluation within the broad guidelines that teacher evaluation be 
intended to improve the quality of instruction and the 
professional development of teachers. Bosetti, the current 
Deputy Minister of Education, noted in the phase I interviews 
reported in Chapter Four that this arrangement provided school 
jurisdictions with a maximum amount of autonomy with respect to 
teacher evaluation practices. The one noteworthy exception to 
this was the requirement that teacher evaluation policies be 
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submitted to a Regional Office of Education so the Department 
could assure that the local policy was adequate with respect to 
due process requirements. 

One question was asked of principals and superintendents 
regarding this policy standard. Specifically, n Has the f due 
process 9 requirement of the Alberta Department of Education 
caused implementation difficulties in your jurisdiction?" 

All 30 of the principal respondents indicated that they had 
no problems with the due process requirement. One principal 
respondent indicated that he anticipated problems in small 
districts where the appeal may be directed to the evaluator, and 
two principal respondents indicated they were concerned with the 
possible paper work associated with an appeal. Not one of the 
principal respondents indicated they have had any direct 
experience with an appeal to date; therefore, the due process 
concept is clearly an untested area within the respondents' 
schools • 

Twenty-six superintendent interviewees responded that they 
had no problems with the due process requirement. Four 
respondents stated they had concerns about the due process policy 
standard. Three of the four were concerned about the problem of 
appeals in small districts, where appeals would be directed to 
the evaluator, and one was concerned about appeals being directed 
to school boards* 

Due process in practice is also largely untested from the 
superintendent's perspective, but eight superintendents reported 
informal appeals which were resolved through mutual agreement 
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with the teacher , such as early retirement , before the appeal 
reached a formal stage. 

The absence of formal appeals in the thirty jurisdictions 
involved in the present study suggests that this particular 
policy standard presents few difficulties in theory with the 
policy implementors. However , when tested in practice, due 
process policy standards may create problems , particularly in 
small jurisdictions, and possibly with the appeal route if school 
boards are demonstrated to lack requisite expertise to judge 
appeal proceedings. 

Policy Resources 

Policy resources are defined by Van Horn and Van Meter 
(1977:107) as the funds and incentives allocated to the policy 
initiative. Teacher evaluation policy was mandated in Alberta 
within the regular funding structures. That is, no additional 
monies were allocated to support the teacher evaluation policy 
implementation process at the jurisdictional level. Incentives 
were more of a resource dependency model where jurisdictions were 
told to implement teacher evaluation policy or face the 
possibility of having funding cut off (King, 1984) . Thei e 
incentives are addressed directly under the enforcement variable 
cluster discussed in Chapter six. 

Given the absence of funding structures in support of 
teacher evaluation policy implementation , and the desire to avoid 
leading questions in the interview schedules , policy resources 
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vere not addressed directly* However, the database of phase II 
interview responses was searched for terms which relate to policy 
resources. The policy resource term which occurred most often 
was "time". Tw^l 7 re teacher respondents, fifteen principal 
respondents and seven superintendent respondents identified lack 
of time for teacher evaluation policy implementation as a factor 
which has weakened their support for implementation of their 
jurisdictions teacher evaluation policy* In addition, two 
teachers, 8 principals and 2 superintendent respondents 
identified additional time for implementation as a future 
resource need to assure that teacher evaluation has a positive 
influence in their jurisdiction. 

Mireau (1986) has noted that demands for more time by 
administrators may be an excuse for avoiding a difficult task, 
tout the frequency with which time as a needed resource is 
mentioned by respondents suggests that this resource need may be 
a very real factor that acts as a distinct barrier to successful 
implementation of teacher evaluation policy in specific 
situations. 

General Impressions of Policy Implementors 

The first question asked of each respondent in the phase II 
interviews was, "Would you share with me your general thoughts on 
teacher evaluation policy implementation in your school (or 
jurisdiction)?" The primary purpose of this question was to 
assist the respondent in focusing thought on the topic of teacher 
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evaluation policy implementation. Respondents in the pilot phase 
of interview schedule development indicated the question was 
useful to their thought processes at the beginning of the 
interview. The question, in itself, does not refer to a specific 
variable cluster in the Van Horn, Van Meter (1977) policy 
implementation model, nor to policy intents, but content analysis 
of the question did reveal some interesting patterns from the 
perspective of the respondents, and are therefore reported here. 

The most frequent comment, by 15 teachers, was that teacher 
evaluation policy was a worthwhile endeavor, indicating a 
significant proportion of teachers who hold a positive general 
orientation toward teacher evaluation policy, in total, teacher 
respondents made 18 positive comments about teacher evaluation 
policy implementation. These positive comments were 
counterbalanced by 17 negative concerns, such as the stressful 
and threatening nature of teacher evaluation, that teacher 
evaluation was t±&e consuming, was implemented suddenly, or that 
administrative evaluators lacked requisite evaluation skills. 
For teacher respondents the positive and negative comments were 
nearly equal. 

Principals tended to be slightly more positive than their 
teacher counterparts. Twenty-five positive comments were made by 
principals versus 21 negative comments. Principals were most 
positive with respect to teacher evaluation policy implementation 
resulting in fine tuned teacher evaluation policy, that it was a 
worthwhile endeavor, that the implementation process was positive 
with adequate opportunity for input, and with the emphasis 
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on formative evaluation. Twenty-one negative comments were made. 
The most common were the time consuming nature of teacher 
evaluation, conflict between their summative and formative roles, 
and unclear evaluation processes or lack of administrator 
evaluation skills. 

Superintendents were most positive of the three phase II 
interview groups. Nineteen positive comments were made by 
superintendents regarding, for example, the fine tuning of 
teacher evaluation policy, the worthwhile nature of teacher 
evaluation, and the opportunity for input to policy formulation 
provided to staff. Only 13 negative comments were mentioned by 
superintendents; the most frequent included the sudden nature of 
policy implementation, and unclear evaluation processes or lack 
of administrator evaluation skills. 

In summary, superintendents were the most positive, followed 
by principals and then teachers. However, even teacher 
respondents were more positive than negative regarding their 
general comments regarding teacher evaluation policy 
implementation in their school. 

Summary and Conclusions 

Phase II interview analysis presented in Chapter Five 
included: comparison of policy intents from the perspective of 
policy makers and policy implementors in the field, general 
impressions of policy implementors, policy standards, and policy 
resources. 
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Policy intents or purposes as defined by policy makers were 
shown to be more congruent with the perspectives of policy 
implementors at the jurisdictional level than at the provincial 
level. The policy intent of providing for professional growth 
and development of teachers is generally not perceived by policy 
implementors. 

The policy implementors in the field perceive the purposes 
or intents of teacher evaluation at the provincial level largely 
as a demonstration of accountability or a Department of Education 
response to political events, one third of the respondents did 
perceive the intent of improving teaching; however, only one 
respondent identified enhancement of the teaching profession as 
an intent of provincial policy. 

On the other hand, 74 respondents linked improvement of 
teaching as a policy intent at the jurisdictional level, 
suggesting that a translation of this policy intent between 
organizational levels has occurred. Essentially, implementors 
perceive teacher evaluation policy at the provincial level to 
have a summative emphasis, and at the jurisdictional J.evel to 
have a formative emphasis. 

The enhancement of the professional status of teaching as a 
policy intent was also absent at the jurisdictional level, since 
". . .professional growth and development of teachers" (Alberta 
Education, I984b:72) is a stated intent of provincial teacher 
evaluation policy, the almost complete absence of this policy 
intent in the perception of policy implementors warrants careful 
consideration by both policy makers and policy implementors. 
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Due process requirements a© a policy standard have not 
presented any difficulties for policy implementors, but this area 
is also largely untested with none of the thirty jurisdictions 
sampled reporting an appeal to the formal stage. Concerns were 
expressed about problems of appeal procedures in small 
jurisdictions. 

Policy resources were not assessed through direct questions 
in phase II interviews, but content analysis of the interview 
database revealed that concerns over "time" as a resource for 
teacher evaluation policy implementation occurred relatively 
frequently. 

Within the Alberta context, the variable clusters, policy 
standards and policy resources ref ±. ct minimal provincial 
involvement relative to teacher evaluation policy implementation. 

General impressions of policy implementors reveal that 
superintendent respondents are most positive regarding teacher 
evaluation policy implementation, and teachers are least 
positive. However, teacher respondents expressed more positive 
than negative comments regarding their general impressions of 
teacher evaluation policy implementation. 
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CHAPTER SIX 



The Effects of Five Process Variables on 
Teacher Evaluation Policy Implementation 

Introduction 

The research question considered in Char' sr Six examines 
the degree to which communications, enforcements, characteristics 
of the .aplementing agencies, political environment, and 
socio-economic environment variables have affected teacher 
evaluation policy implementation. These five variable clusters 
from the Van Horn and Van Meter (1977) policy implementation 
model zse examined in relationship to phase II interview results 
and in terms of their effect on teacher evaluation policy 
implementation in Alberta. 

Communications 

Communications variables are defined by Van Horn and Van 
Meter (1977:108-109) as the clarity with which policy standards 
are communicated to implementors, so they will know what is 
required of them, and the interpretations implementors place on 
the progran and acceptable local performance. 

Two questions were asked of teachers, principals and 
superintendents in phase II interviews regarding the 
communications variable cluster: 




71 

1 # "In what way were the teachers involved in developing 
your jurisdiction's evaluation policy?" and, 

2. "Are policy expectations from the school office (central 
office for principals or Alberta Education for superintendents) 
sufficiently clear from your point of view to define what is 
expected of you in the teacher evaluation implementation 
process?" 

Responses to the first question are summarized in Table 4. 
In some cases, more than one mechanism for input to policy 
formulation was available; therefore, totals exceed ' he number of 
respondents. 

Table 4 

Phase II Respondent Identified Teacher Involvement in 
Policy Development - Communications Variable 



Response 



Tchrs. Prins, Supts. Total 



Teacher representatives 
on a policy civiunittee 

Via principal; 
discussion at staff 
meetings 

No opportunity 
tor input 

Via direct request 
to each teacher to 
react to policy 

Don't know or 
not sure 



10 



12 



11 



4 
0 



21 

11 

0 

8 

0 



43 

30 
15 

14 
9 



note : Tchrs • -Teachers , Prins . =Pr incipals , supts . =Superintendents « 



ERLC 



84 



72 



Superintendents in every jurisdiction reported that teachers 
had some mechanism for input into policy formulation. However, 
nine principals and fifteen teachers reported either no 
opportunity for input or uncertainty regarding mechanises for 
input into formulation of teacher evaluation policy. This 
discrepancy demonstrates the difficulty of communication through 
multiple levels of an organization and pinpoints a problem area 
which King referred to in the phase I interviews. That is the 
possibility that teachers have lacked real opportunity for input 
into defining what teacher evaluation policy should be. The 
quality of input when mechanisms for input were available is an 
additional concern. Several teachers commented on this factor: 
n . . .actual input was more on method; the need for policy was 
generally accepted", or "We were involved, but there was a 
feeling of inevitability to the process; key issues were not 
addressed." In addition, seven principals who observed 
discussion of teacher evaluation either on committees or at staff 
meetings commented on the minimal dialogue among teachers that 
occurred, giver 'he importance of the topi for teachers. 
Lastly, the comments of one superintendent are significant, 

- .feedback wr>s minimal, [teacher evaluation policy] seemed to 
be generally accepted. . . .1 sometimes wonder to what degree 
teachers were actually involved." 

Recall that King's concern was that the Keegstra affair, 
while facilitating policy implementation on the one hand by 
eliminating resistance to teacher evaluation policy 
implementation, on the other hand may have done harm in limiting 

85 

o j.- 
ERIC 



73 



opportunities for teacher input into policy formulation at the 
local level. Teacher responses to the question about opportunity 
for input, where 50% of the respondents indicated no opportunity 
and several respondents who had opportunity but characterized it 
as a fait accompli, seem to lend credibility to King's concern. 

The second question addressed the adequacy of communication 
regarding the interviewees understanding of policy and their 
responsibilities relative to their position as a teacher, 
principal or superintendent. Responses to the second 
communications question are summarized in Table 5. 

Table 5 

Phase II Respondsnt Identified Policy Expectations - 

Communications Variable 

Response Tchrs. Prins. Supts. Total 

Yes, policy and 
expectations clearly 

understood 20 25 25 70 

No, policy vague or 

not clarified 10 5 5 20 

note ; Tchrs . =Teachers , Prins . =Pr incipal s , Supts . ^Superintendents . 



Communications regarding role responsibilities relative to 
teacher evaluation are clearer foi administrators than for 
teacher respondents. This finding is not surprising in view of 
the fact that teachers felt they had less opportunity for input 
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into policy formulation than did the administrator respondents • 
Some clarification of policy, particularly for teachers, but 
also for principals and superintendents in several jurisdictions 
is needed ♦ 

On a more positive note, six of the superintendent 
respondents noted the usefulness of the Regional Offices of 
Education in policy development and clarification of teacher 
evaluation policy implementation. 

E nforcemen t? 

Van Horn and Van Meter (1977:110) suggest that enforcements 
are of three types: norms, incentives, and sanctions, which 
correspond to Etizoni's distinction between normative, 
remunerative and coercive forms of ^ower. 

The enforcements variable cluster was addressed with one 
question to teachers, principals and superintendents, an 
additional question to principals and superintendents, and two 
more questions to superintendents only. 

The enforcement question addressed to all three respondent 
levels was: "What m*;ans have been used in your school (or 
jurisdiction) to encourage teachers to cooperate with the teacher 
evaluation policy? H 

Responses to this question are summarized in Table 6. 
No interviewee suggested that enforcements of a 
remunerative-incentive type were occurring. An interesting 
discrepancy appears from the perspective of teachers versus 
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administrators. Thirteen teachers perceived a must do or 
coercive-sanction enforcement pattern, while only three 
principals and five superintendents held this view. On the other 
hand, 13 teacher respondents perceived a normative-formative 
eonphasis or a normative-formative emphasis linked with a must do 
approach, whereas 26 principal respondents and 13 superintendent 
respondents held this point of view. Clearly, administrator 
respondents view the enforcements used to induce teacher 
cooperation with teacher evaluation policy as a more normative 
process than do the teacher respondents. 

Table 6 



Phase II Respondent Identified Means Used to Encourage 
Teacher Cooperation with Teacher Evaluation Policy - 

Enforcements Variable 



Response 


Tchrs , 


Prins. 


Supts. 


Total 


Both must do policy 
with a formative 
emphasis 


11 


18 


12 


41 


A must do emphasis/ 
DOE policy requirement 


13 


3 


5 


21 


Learning process/ 
formative emphasis 


2 


8 


1 


11 


Little effort to 
clarify policy 


4 


1 


3 


8 


Provided for teacher 
input to policy 
process 


0 


0 


8 


8 


By example, with 
emphasis on fairness 


0 


0 


1 


1 


note: Tchrs. teachers, Prins. 


=Principals 


Supts. 


=Superin\;ender.ts . 



ERIC 



76 



Two teachers commented that teacher evaluation policy was 
viewed by tenured teachers as a non-issue primarily affecting the 
non-tenured staff. Thirteen teacher respondents commented on the 
stress producing, negative aspect of teacher evaluation, and 
thirteen teacher respondents made positive comments regarding the 
teacher evaluation process. 

The second enforcements quention, addressed to principals 
and superintendents was: M What means have been used ir your 
jurisdiction to encourage principals to implement the teacher 
evaluation policy?" 

Responses to this question are summarized in Table / • 

Table 7 

Phase II Respondent Identified Mear.s Used to Encourage 
Principal Cooperation with Teacher Evaluation Policy • 

Enforcements Variable 

Response Prins. Supts. Total 



Both a policy 
directive and linked 
to a normative 

approach 12 25 37 

Policy directive 8 4 12 

Collegia! approach * 
with normative 

emphasis 9 1 10 

Nothing, supt. does 
all teacher 

evaluations 10 1 



note : Prins . = ^rinc* \ uls , Supts . -Superintendents . 
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More congruen ^ between the perspectives of principals and 
superintendents regarding enforcements used to encourage 
principal cooperation with teacher evaluation policy exists, than 
between respondent groups for enforcements for teacher 
cooperation. 

Twenty-one principal respondents and twenty-six 
superintendent respondents perceived either a normative emphasis 
or a normative emphasis linked with a policy directive or 
sanction approach. 

The emphasis on improvement of instruction given to 
jurisdictional level policy intents is apparent in the 
prepondance of normative-collegial enforcement strategies 
reported by administrators. 

The third and fourth enforcement questions were asked only 
of superintendents. They were: "The Alberta Department of 
Education has used 'must do 1 statements to ensure that school 
jurisdictions implement teacher evaluation policy, what has been 
your reaction to the appropriateness of these means used to 
ensure compliance with provincial mandates to implement teacher 
evaluation policy?" and, "Would you recommend other means to 
ensure compliance with provincial policy?" 

Seventeen superintendent respondents indicated a positive 
reaction to provincial enforcement strategies. Three of the 
seventeen suggested sanctions were necessary because earlier 
attempts at volunteer implementation had not worked. 

Ten superintendents responded with mixed reactions, of the 
ten, one suggested the provincial approach put teachers in a 
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defensive position? two stated they did not think the Department 
of Education had sold the need for ter.cher evaluation 
sufficiently; three argued the Department shouxd not treat all 
jurisdictions equally as the Management and Finance Plan does; 
^nd one noted that resources are too limited • 

Three superintendent respondents stated they had a negative 
reaction to provincial enforcement strategies. Reasons for their 
negative reaction included: their jurisdiction had already been 
doing teacher evaluation and sanctions were not necessary; that 
teacher evaluation is not an area for the Department to be 
involved in; or the implementation model is too top down. 
The last enforcements question asked superintendent 
respondents if they would recommend other means to assure 
compliance with provincial teacher evaluation policy. 

Twelve respondents said no. Five suggested a need for 
regular monitoring of policy implementation by provincial 
authorities. Four argued for more consultation and support 
mechanisms. Two suggested a need for more sensitivity to local 
differences. Four stated a need for wider input into the policy 
adoption process, such as more representation by the Alberta 
Teachers 1 Association and the Alberta School Trustees 1 
Association. Two noted u need for the Department of Education to 
demonstrate need for teacher evaluation more effectively. 
Lastly, one stated a need to revise policy to a mora 
goals/results orientation away from the current process 
orientation. 
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In summary, administrator respondents view the enforcements 
used to induce teacher cooperation with teacher evaluation policy 
as a more positive process than do the teacher respondents. 
However, the emphasis on improvement of instruction given to 
jurisdictional level policy intents is apparent in the 
prepondance of normative! enforcement strategies reported by 
administrators at the local level of implementation. 

Twenty-seven superintendent respondents reacted either 
favorably or with mixed support for provincial enforcement 
strategies. However, eighteen superintendent respondents made 
suggestions regarding how provincial enforcements might be 
adjusted which indicates a need to review enforcement strategies 
by provincial officials. 

Characteristics of the Implementing Agency 

"an Horn and Van Meter (1977:114) define the characteristics 
of the implementing agency variable cluster as, . .the 
experience and competence of the staff to perform the tasks 
required of them." 

Five questions were formulated to address this variable 
cluster. 7he first question was asked of superintendent 
respondents only and was, "Who has responsi' 3 ity for evaluating 
teachers in your jurisdiction?" Three ques .ions addressed the 
issue of whether the teachers, principals and central office 
supervisory personnel have had training specifically in teachor 
evaluation, and what training has been inost useful. A fifth 
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question asked, "To what degree are you satisfied with your 
jurisdiction's methods used to measure teacher performance?" 

Eighteen superintendent respondents reported that 
responsibility for teacher evaluation was shared between 
principals and central office staff. Of these eighteen, eleven 
identified principal responsibility for primarily formative 
evaluation and central office staff for ruminative evaluations; 
four indicated teacher evaluation was a shared activity without 
any clear role differentiation between administrative levels; one 
respondent stated principals were responsible for non-tenured 
staff and central office personnel for tenured staff evaluations, 
and two repondents noted the converse (i.e., principals 
responsible for tenured teachers and central office for 
non-tenured teachers) . 

Twelve superintendent respondents identified principals as 
primarily responsible for all teacher evaluation, with central 
office personnel providing only a backup role when needed. 

All three respondent levels were asked what training had 
been provided to teachers to facilitate their understanding and 
cooperation with teac^r evaluation policy implementation in 
their jurisdiction. 

The results of this question are reported in Table 8. 
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Table 8 

Phase II Respondent Identified Training Provided to 
Teachers - Characteristics of the Implementing 
Agency Variable 



Response 


Tchrs . 


Prins. 


Supts . 


Total 


No training 


15 


13 


11 


39 


Orientation to 
jurisdiction evaluation 


9 


7 


12 


28 


Professional 
development workshops 


7 


12 


5 


24 


Policy development 
meetings 


1 


3 


2 


6 


University courses 


1 


0 


0 


1 



note : Tchrs . =Teachers , Prins . ^Principal s , Supts . =Super intendents « 

Many jurisdictions have not addressed the question of 
teacher training in support of teacher evaluation policy 
implementation. One-half of the teacher respondents could not 
identify any training or inservice activities specifically on 
teacher evaluation. Orientations to jurisdictional evaluation 
procedures were most frequently cited as a means of preparing 
teachers for their roles in teacher evaluation processes. 
Professional development activities were reported by 24 
respondents who often reported that training had not been 
presented or*, teacher evaluation specifically, but on effective 
teaching strategies which was f ormally or informally linked to 
teacher evaluation criteria. 

Discrepancies between respondent levels is likely due to 
variation in exposure to training activities that had been 
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provided. It is significant that few jurisdictions have given a 
priority to teacher inservice on teacher evaluation specifically. 
Several administrator respondents commented that the professional 
development concern/priorities have passed on to other things. 
Only principal and superintendent respondents were asked 
about training specifically on teacher evaluation provided for 
principals. Responses to this question are summarized in Table 
9. Many respondents indicated more than one training 
opportunity; therefore, total responses exceed the number of 
respondents. 

Table 9 

Phase II Respondent Identified Training Provided to 
Principals - Characteristics of the Implementing 

Agency Variable 



Response 


Prins. 


Supts . 


Total 


Seminars, conferences, 


29 


23 


52 


and workshops 




University courses 


15 


8 


23 


Mireau inservice materials 


2 


9 


11 


On the job experience 


6 


1 


7 


Readings 


1 


0 


1 


note: Pnns. -Principals, Supts.=superintendents. 


All administrator respondents 


identi id 


at least 


one 


training opportunity specifically 


on teacher 


evaluation. 



Workshops, conferences and seminars on teacher evaluation were 
rated as most useful by eight principals, and university courses, 
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primarily on clinical supervision were rated most useful by seven 
principals* Effective teaching programs were frequently 
mentioned as highly effective and desirable as a focus for 
further inservice linked to teacher evaluation training. 

It is clear that principals have had opportunity to 
experience some inservice training in support of their teacher 
evaluation responsibilities. 

In response to a sub-question ire^arding what additional 
training would be most helpful, twelve administrator respondents 
suggested teacher effectiveness training; eight expressed the 
need for more practical experience; six for university teacher 
supervision courses; eight for collegial supervision models or 
trust building/helpful evaluation strategies; and two for a 
review of research and evaluation instruments. 

Superintendent responder verfc asked what specific teacher 
evaluation training central office supervisory personnel had 
experienced. Most respondents indicated more than one type of 
trairing; therefore, the number of responses exceed the number of 
respondents. The response category and frequency of responses 
are summarized below: 

workshops, seminars, and conferences 23 

university courses 18 

Mirsau inservice materials 10 

on the job experience 3 

Teacher Perceivcr materials 2 

other 3 

no training 1 
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Six superintendent respondents suggested workshops, seminars 
and conferences had been most useful to them. University 
courses, on the job experience and the Mireau inservice materials 
were identified by two respondents respectively as most useful to 
them. Ten superintendent respondents mentioned effective 
teaching inservice as useful especially in a workshop format. 
Richard Manatt's work on teacher evaluation was often identified 
as useful. 

In response to the sub-question, regarding what additional 
training would be useful, 14 respondents stated no need for more 
inservice on teacher evaluation, or were unsure of specific 
needs. Five suggested need for more workshops, seminars or 
conferences. Four noted collegial-trust building or help 
strategxu. inservice sessions are needed. Two expressed need for 
effective teaching inservice, two asked for contact with other 
practioners and for practical evaluation models, one stated a 
desire for evaluation of evaluators, and one respondent wanted 
inservice on report writing skills. 

Superintendent respondents, like their principal 
counterparts, have had opportunity to experience some inservice 
training in support of their evaluation activities. Half of the 
superintendent respondents identified a need for additional 
inservice training. 

The last question which addressed the characteristics of the 
implementing agency variable cluster asked if teacher, principal 
and superintendent respondents were satisfied with the 
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jurisdictions' methods used to measure teacher performance. 
Responses to this question are summarized in Table 10 

Table 10 



Phase II Respondent Identified Satisfaction with 
Methods Used to Measure Teacher Performance - 
Characteristics of the Implementing Agency Variable 



Response 


Tchrs . 


Prins, 


Supts . 


Total 


Evaluation criteria 
and anecdotal format 
is good 


15 


11 


12 


37 


Format and criteria 
is acceptable 


7 


7 


13 


27 


Format and criteria 
is vague/poor 


5 


8 


3 


18 


Need more time in 
evaluation process 


2 


4- 


0 


6 


Format flexibility 
is good 


0 


2 


3 


5 


Clinical supervision 
model is good 


1 


0 


2 


3 


Need standardized form 
to assure fairness 


2 


0 


0 


2 


Need description of 
teaching context 
included 


1 


0 


0 


1 


More objectivity 
is needed 


0 


1 


0 


1 



note: Tchrs. ^Teachers, Prins.^Princip^ls , gupts , Superintendents . 



The strongest single theme to emerge £rpm analysis of this 
question was the preference expressed by many respondents for 
anacdotal evaluation reporting formats. 
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Overall 64 respondents expressed high or moderate levels of 
satisfaction with methods used to evaluate teacher performance. 
Eighteen respondents indicated dissatisfaction with evaluation 
format and criteria • This dissatisfaction was linked by some 
respondents to such factors as a lack of a standardized form to 
assure fairness, the need for a description of the teaching 
context in the evaluation report, and the need for more 
objectivity. 

Much divergent opinion was observed in response to this 
question. What was seen as a strength in a method by one 
respondent, for example the flexibility of anecdotal reporting 
fonaats, was seen as a weakness by another respondent. This 
observation lends support to Darling, Hammond and Wise f s (1985) 
argument for custom designing teacher evaluation method to the 
specific needs of a jurisdiction at a given point in time. 

In summary, in twelve jurisdictions principals are primarily 
responsible for all teacher evaluation, with central office 
personnel providing only a backup role when needed. In the other 
18 jurisdictions sampled teacher evaluation is a shared 
responsibility between principal and superintendent. 

Few jurisdictions have given a priority to teacher inservice 
on teacher evaluation specifically. Several administrator 
respondents commented that the professional development 
concern/priorities have passed on to other things. 

It is clear that principals and superintendents have had 
opportunity to experience some inservice training in support of 
their teacher evaluation responsibilities. 
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The strongest single theme to emerge from analysis of the 
question about satisfaction with evaluation methods in use was 
the preference expressed by many respondents for anecdotal 
evaluation reporting formats. 

Overall 64 of 90 respondents expressed high or moderate 
levels of satisfaction with methods used to evaluate teacher 
performance; however, divergence of opinion regarding evaluation 
methodology supports the wisdom of designing evaluation 
methodology to fit local evaluation intents and expectations. 

Political Environments 

The political environment its defined by Van Horn and Van 
Meter (1977:114) as "The extent of support for or oppostion to 
the policy objective. . . ." 

Two questions were asked of principal and superintendent 
respondents to assess the political environment in their 
communities. They were: 

"How has implementation been affected by the jurisidiction's 
political climate? For example, was teacher evaluation an issue 
in the October 20, 1986 board elections?" and, 

"Have you tried to make parents or parent groups aware that 
a new teacher evaluation policy is being implemented in your 
school (jurisdiction)? How effective has this been?" 

Responses to the first question, summarized in Table 11, 
demonstrate that teacher evaluation has been remarkably absent as 
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a political issue in local communities from the perspective of 
both principals and superintendents. 

Table 11 

Phase II Respondent Identified Jurisdictional 
Political Effect on Policy Implementation - 
Political Environment Variable 



Response 


Prins, 


Supts . 


Total 


No effect; not 
perceived as an issue 


22 


24 


46 


A minor issue 


8 


6 


14 


note: Prins.=Principals, Supts. 


^Superintendents . 





In those jurisdictions where teacher evaluation was seen as 
a local issue, it was perceived to be of a minor nature usually 
based on community dissatisfaction with an individual teacher. 
Significantly, no respondent indicated that teacher evaluation 
had been a major issue in their jurisdiction. 



Political pressure for teacher evaluation does not appear to 
have been a grass roots phenomenon that was manifested through 
local political channels, such as school board elections. 

The second political environment question asked to what 
extent school prinicpals or superintendents had attempted to keep 
parents or parent groups informed about teacher evaluation policy 
implementation. If teacher evaluation was a key political issue 
at the local level, it was anticipated that school jurisdictions 
would have been active in communicating progress regarding 
teacher evaluation policy implementation to their publics. The 
response categories to this question are summarized in Table 12. 
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Table 12 

Phase II Respondent Identified Jurisdictional 
Attempts to Inform Parents about Teacher 
Evaluation Policy Implementation - 
Political Environment Variable 



Response 


Prins. 


Supts . 


Total 


No attempts 


17 


5 


22 


Minimal attempts 


7 


15 


22 


Multiple, proactive 
attempts to inform 
parents 


6 


10 


16 



note : Prins . =Pr incipals , Supts . =Super intendents • 



Forty-four respondents indicated either no or minimal 
attempts at informing parents or their publics regarding teacher 
evaluation policy implementation in their jurisdictions. Minimal 
attempts were interpreted as passive communications, usually in 
annual reports or through regular media coverage of board 
meetings. Proactive attempts were interpreted as specific forums 
held to inform the public, letters mailed directly to parents, 
specific press releases intended to focus media attention on 
teacher evaluation policy implementation, or some combination of 
specific attempts at communicating to the public. One-third of 
the sampled jurisdictions had used proactive mechanisms to inform 
their community. Superintendents were more aware of this process 
than were principal respondents, but generally had a casual 
perception of how effective communication efforts had been at 
informing parents. 
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In summary, political support for teacher evaluation does 
not appear to have been a grass roots phenomenon that was 
manifested through local political channels* The majority of 
school jurisdictions sampled have taken no action or minimal 
action to communicate to their publics about teacher evaluation 
policy implementation and thus engender greater community support 
for continued implementation of this policy initiative. 

Socio-Economic Environments 

Van Horn and Van Meter (1977:114) indicate that social and 
economic variables refer to environmental conditions affecting 
the policy implementation process. For example, the type of 
community economic resources can affect the kinds of services 
rendered and their relative importance, Van Horn and Van Meter 
(1977:115) suggest. 

This variable cluster was the most elusive to tap given the 
specific policy being studied and the context of implementation. 
None of the pilot questions in the phase II interviews survived 
the interview schedule development process to assess the 
sodio-economic variable cluster directly. In addition, the 
background literature review did not identify local 
socio-economic factors as being important to the implementation 
of teacher evaluation policy. Essentially, factors which were 
identified as important seemed to be adequately covered by the 
other seven variable clusters of the Van Horn and Van Meter 
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(1977) policy implementation model relative to the particular 
application of the model in the current study. 

Summary and Conclusion 

Five variable clusters from the Van Horn and Van Meter 
(1977) policy implementation model, Communications, Enforcements, 
Characteristics of the Implementing Agency, Political 
Environments and Socio-Economic Environments were examined in 
Chapter Seven in relationship to phase II interviews and in terms 
of their effect on teacher evaluation policy implementation in 
Alberta* 

Teachers felt they had less opportunity for input into 
policy formulation than did the administrator respondents. Some 
clarification o,f policy, particlularly for teachers, but also for 
principals and superintendents in several jurisdictions is 
needed. 

Administrator respondents view the enforcements used to 
induce teacher cooperation with teacher evaluation policy as a 
more normative process than do the teacher respondents. However, 
the emphasis on improvement of instruction given to 
jurisdictional level policy intents is apparent in the 
preponderance of normative enforcement strategies reported by 
administrators at the local level of implementation. 

Twenty-seven superintendent respondents reacted either 
favorably or with mixed support for provincial enforcement 
strategies. However, eighteen superintendent respondents made 
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suggestions regarding how provincial enforcements might be 
adjusted which indicatec a need to review enforcement strategies 
by provincial officials. Five suggested a need for regular 
monitoring of policy implementation by provincial authorities. 
Four argued for more consultation and support mechanisms. Two 
suggested a need for more sensitivity to local differences. Four 
stated a need for wider input into the policy adoption process, 
two noted a need for the Department of Education to demonstrate 
need for teacher evaluation more effectively , and one stated a 
need to revise policy to a more goals/results orientation away 
from the current process orientation. 

' It is significant that few jurisdictions have given a 
priority to teacher inservice on teacher evaluation specifically. 
Several administrator respondents commented that the professional 
development concern/priorities have passed on to other things. 
It is clear that principals have had opportunity to experience 
some inservice training in support of their teacher evaluation 
responsibilities. Superintendent respondents, like their 
principal counterparts, have had opportunity to experience some 
inservice training in support of their evaluation activities. 
Half of the superintendent respondents identified a need for 
additional inservice training. 

In 12 jurisdictions principals are primarily responsible for 
all teacher evaluation, with central office personnel providing 
only a backup role when needed. In the other 18 jurisdictions 
sampled teacher evaluation is a shared responsibility between 
principal and superintendent. 
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The strongest single theme to emerge from analysis of the 
question about satisfaction with evaluation methods in use was 
the preference expressed by many respondents for anecdotal 
evaluation reporting formats. 

Overall 64 of 90 respondents expressed high or moderate 
levels of satisfaction with methods used to evaluate teacher 
performance, however, divergence of opinion regarding evaluation 
methodology supports the wisdom of designing evaluation 
methodology to fit local evaluation intents and expectations. 

In those jurisdictions where teacher evaluation was seen as 
a local issue, it was perceived to be of a minor nature usually 
based on community dissatisfaction with an individual teacher. 
Significantly, no respondent indicated that teacher evaluation 
had been a major political issue in their jurisdiction. 

Political support for teacher evaluation does not appear to 
have been a grass roots phenomenon that was manifested through 
local political channels. The majority of school jurisdictions 
sampled have taken no action or minimal action to communicate to 
their publics about teacher evaluation policy implementation and 
thus engender greater community support for continued 
implementation of this policy initiative. 
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CHAPTER SEVEN 



Disposition of the Implementors, 
Policy Effects, and Anticipated 
Future Needs 

Introduction 

Research questions and sub-questions addressed in Chapter 
Seven include: 

To what degree has the disposition of implementors affected 
policy implementation? 

What were the percevied policy effects held by policy 
implementors? 

Were perceptions of effects between policy makers and 
implementors congruent? 

How similar were the expectations of policy makers and 
implementors for full implementation of teacher evaluation 
policy? 

What future adjustments to teacher evaluation policy 
implementation were perceived to be needed by policy makers and 
policy implementors? 

Disposition of the Implementors 

Disposition of the implementors refers to elements of the 
implementors 1 response to policy which may affect their ability 
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or willingness to implement, for e^mple, their understanding of 
policy standards, the direction of t^eir response to them, and 
the intensity of their response (Van Horn and Van Meter, 
1977:113) . 

Four questions were asked in the phase II interviews that 
relate to the disposition of the implementors variable cluster. 
The first three questions were asked of all respondent levels 
(i.e., teachers, principals and superintendents), but were 
reworded for each respondent level to be applicable to that 
level. The fourth question was asked only of superintendents. 

The first question asked teachers if anything had weakened 
their support for implex ntation of the jurisdiction's teacher 
evaluation policy, and asked principals and superintendents if 
any aspects of the policy had resulted in resistance by teachers. 
The responses to this question set are summarized in Table 13. 

Some discrepancy is apparent between the perspectives of 
teachers versus administrators. Administrative respondents 
tended to be less aware of sources of teacher resistance; 
however, it is notable that more than cne third of the teacher 
respondents stated that nothing had weakened their suppport for 
implementation oi ? teacher evaluation policy. 

The most frequent source of resistance perceived by 
teachers, but largely missed by administrators, was subjective, 
insufficient or invalid bases of teacher evaluation. Other 
s7or.es of resistance identified by all three responded * groups 
.tie role of the principal relative to formative versus 
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Table 13 



Phase II Respondent Identified Sources of Teacher 
Resistance to Implementation of Teacher Evaluation 
Policy - Disposition of the Implementors Variable 



Response Tchrs . 


Prins. 


Supts . 


Total 


No resistance 


12 




19 


50 


Empirical base too 

sub j ect ive ; insufficient 

or invalid data 


8 


1 


1 


10 


Principal should do 

only formative evaluation 


3 


1 


4 


8 


Stress; anxiety and 
exhaustion of evaluating 


1 


4 


2 


7 


Some staff evaluated 

too often; others too seldom 


1 


0 


3 


4 


Lack of central office 
involvement/support 


1 


2 


0 


3 


Lack of training/ 
skills of evaluators 


1 


1 


0 


2 


Repeated postponement of 
scheduled visits 


1 


1 


0 


2 


Lack of time spent 
in evaluation process 


1 


0 


0 


1 


Use of evaluation to 
terminate teachers 
unpopular in the community 


1 


0 


0 


1 


Confusion re: teaching 
effectiveness criteria 
linked to evaluation 


0 


1 


0 


1 


Need for expertise in 
subject area by evaluator 


0 


0 


1 


1 



note: Tchrs. =Teacher S/ Frins.=Principal S/ Supts. =superintendents. 
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summative evaluation; the stress, anxiety and exhaustion 
associated with evaluation; and the unequal application of 
teacher evaluation across staffs. 

Interestingly, administrative respondents identified the 
stress/anxiety factor more often than the one teacher respondent 
who noted this phenomenon. Other sources of resistance were 
noted by only one or two respondents, but the responses do 
identify potential sources of resistance by teachers and are 
therefore worthy of note by policy implementors as a potential 
problem area in a particular jurisdictional setting. 

One teacher respondent stated "I support the concept [of 
teacher evaluation] in abstract, but dread it in practice" which 
seemed an apt description of the paradox of evaluation which 
teachers experience. 

These findings suggest the existence of a substantial base 
of support for teacher evaluation policy by members of the 
teaching profession, but also the presence of a number of 
concerns, which if not addressed, could result in increasing 
resistance by teachers to implementation of teacher evaluation 
policy in Alberta. 

The second question in the disposition of the implementors 
variable cluster asked teachers if any aspects of teacher 
evaluation policy had caused implementation difficulties for the 
school administrative staff, and asked principals and 
superintendents if anything had weakened their support for 
implementation of their jurisdictions teacher evaluation policy. 
Responses to this question are summarized in Table 14. 
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Table 14 



Phase II Respondent Identified Sources of Administrator 
Resistance to Implementation of Teacher Evaluation 
Policy - Disposition of the Implementors Variable 



Response Tchrs. Prins. Supts. Total 

Time; support resources 14 17 8 39 

not adequate 

Need more training; 

improved empirical base 3 2 16 

Role confusion between 
summative/ formative 
evaluation; lack of 

direction 2 3 0 5 

Lack of commitment to 

implementing policy 2 0 2 4 

Lack of central office 

support 0 3 0 3 

Unclear articulation 
between evaluation policies; 
teacher evaluation 

focus too diffuse 0 0 3 3 

Negative effect on student- 
teacher time 0 0 2 2 

Negativism associated 
with a teacher dismissal; 
need for more positive 

emphasis 0 - 0 2 2 

Communicating evaluation 

results to teachers 1 o 0 l 



No problems with it 8 5 12 



25 



note: Tchrs . ^Teachers , Prins .^Principals, Su pts .^Superintendents, 
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Most administrative respondents qualified their response 
with a statement that even though problem areas exist, their 
commitment to implementing teacher evaluation policy was not 
lessened by the existence of the ^ jblem areas. 

Inadequate time for implementation of teacher evaluation 
policy was discussed in Chapter Five in relationship to Policy 
Resources, but it warrants repetition here in that this factor 
was the most frequently mentioned item that had presented a 
problem to implementors. Perhaps most importantly, principal 
respondents, who are crucial to the teacher evaluation process, 
expressed their concern over time and inadequate resources twice 
as often as superintendent respondents. Teacher respondents 
identified this area as a problem for their principals almost as 
often as the principal respondents, lending credibility to the 
principal respondents 1 concerns. 

Lack of time may be an excuse used by some administrators to 
avoid a complex, difficult and demanding process (Mireau, 1986) . 
On the other hand, the fact that this problem is identified by so 
many respondents argues for implementation strategies at all 
levels that confront this concern directly in order to remove it 
as a real or perceptual barrier to successful implementation of 
teacher evaluation policy. 

Teacher and principal respondent categories also exhibited 
close agreement in terms of the numbers of responses relative to 
the need for evaluators to have more training and an improved 
empirical basis for evaluation, and to the existence of role 
confusion between summative and formative evaluative efforts and 
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the lack of direction with respect to the overall teacher 
evaluation processes. 

The other response categories noted in Table 14 were 
identified by only one to three respondents in one respondent 
category, but again the areas of concern warrant review by policy 
implementors in order to determine the relevance of the specific 
concern to implementation efforts in a particular jurisdiction. 

Twenty-five respondents, primarily superintendents and 
teachers, indicated they had no problem with implementation. 
Only five principal respondents indicated no problems with 
teacher evaluation policy implementation. 

The third question relating to disposition of the 
implementors was asked in the same format of all respondent 
groups, and queried whether the interviewee thought the Alberta 
Department of Education's commitment to having the provincial 
teacher evaluation policy implemented is as strong today as it 
was in 1984-85 when it was introduced. The responses to this 
question are summarized in Table 15. 

An important theme in the policy literature relates to the 
importance of policy makers demonstrating a visible and high 
commitment to implementation of the policy initiatives on an 
on-going basis. Such a commitment is not percieved by a large 
proportion of the respondents in the current study. Fifty-nine 
of ninety respondents believed the Department's commitment to be 
weaker or were not sure or held no opinion. Administrator 
respondents held this perspective more often than did teacher 
respondents, which is unusual given the more direct communication 
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channels between administrators and the Department of Education, 
Teacher respondents who perceive Departmental commitment to be as 
strong or stronger may be making an assumption, whereas 
administrative respondents may perceive directly that 
departmental commitment has dissipated • 

Table 15 



Phase II Respondent Perceptions of Departmental 
Commitment to Implementation of Teacher Evaluation 
Policy - Disposition of the Implementors Variable 





± Lllib • 


ST L. Xlls • 




rp n f a i 
JL Otal 


As strong or stronger 


7 


1 


l 


9 


-DOE still sensitive 










to need 


1 


6 


5 


12 


-A rout ine now 


6 


2 


1 


9 


-Part of MFP 










commitment 


0 


0 


1 


1 


Stronger sub-total 


14 


9 


8 


31 


Weaker 


3 


1 


0 


4 


-Shifted to boards 


1 


1 


0 


2 


-Shifted focus to 










other areas 


5 


6 


6 


17 


-Less public and 










political pressure 


5 


5 


4 


14 


-Lack of dollar 










resources will limit 










implementation 


1 


4 


0 


5 


-Lack of follow- 










through/monitoring 


0 


1 


11 


12 


Weaker sub-total 


15 


18 


21 


54 


Not sure/ no opinion 


1 


3 


1 


5 



note : Tchrs . =Ter? ohers , Pr ins . =Principals , Supts . =Superintendents , 
MPP=Management and Finance Plan 
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Teacher evaluation was accompanied during its initial 
implementation by a high level of media coverage associated with 
the Keegstra affair. As noted in Chapter Four, the policy makers 
were aware of the facilitating effect that the Keegstra incident 
was having on teacher evaluation policy implementation. In 
addition, the Department of Education gave teacher evaluation a 
high priority in the early stages of implementation (King, 1984) . 
Kaintaining a high priority and visibility would tax the energies 
of any organization, so it is not surprising that over time 
policy implementors would perceive the Department's commitment to 
be declining. The findings reported here, however, argue for a 
resurgence of conveying Departmental commitment in the short 
term, and for a strategy of periodic reinforcement of visible 
manifestations of Departmental commitment over the long term. 

The final question relating to disposition of the 
implementors was directed only to superintendent respondents, and 
asked "What is the priority of evaluating teachers for board 
members?" 

Fifteen superintendent interviewees responded that teacher 
evaluation was a high priority with board members accompanied 
with a proactive, highly visible advocacy of teacher evaluation 
by the board. Ten respondents said teacher evaluation was a high 
priority with their board, but was accompanied by a reactive 
stance and quiet advocacy. Four superintendent respondents 
stated teacher evaluation was a moderate priority for their 
board, and one noted that teacher evaluation was not an issue for 
the school board. 
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At the local level superintendents perceive their school 
boards to be maintaining a high commitment to implementing 
teacher evaluation policy, with 25 of the 30 jurisdictions 
sampled reporting a high commitment by their boards to 
implementation of teacher evaluation policy. Some concern might 
be expressed that ten of the boards with a high commitment are 
not seen by their superintendents to be actively demonstrating 
this commitment and an additional five school boards sampled are 
percieved to have moderate or low commitment and are also not 
actively expressing a commitment to implementation of teacher 
evaluation policy. 

Two superintendent respondents commented that interest on 
their board is declining or shifting to other concerns. If this 
observation portends a trend, then the perception of many policy 
implementors that the Department of Education's commitment is 
declining would only be reinforced by a perception that their own 
board's commitment is also declining. 

In summary, responses to questions regarding the disposition 
of the implementors indicated a substantial base of support for 
teacher evaluation policy by members of the teaching profession, 
but also the presence of a number of concerns, which if not 
addressed, could result in increasing resistance by teachers to 
implementation of teacher evaluation policy. 

Inadequate time for implementation of teacher evaluation 
policy was the most frequently mentioned item that had presented 
a problem to implementors. Perhaps most importantly, principal 
respondents, who are crucial to the teacher evaluation process, 
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expressed their concern over inadequate time and resources twice 
as often as superintendent respondents. Teacher respondents 
identified this area as a problem for their principals almost as 
often as the principal respondents, lending credibility to the 
principal respondents' concerns. 

Teacher and principal respondent categories also exhibited 
close agreement in terms of the numbers of responses relative to: 
1) the need for evaluators to have more training and an improved 
empirical basis for evaluation; and 2) the existence of role 
confusion between summative and formative evaluative efforts and 
the lack of direction with respect to the overall teacher 
evaluation processes. 

Fifty-nine of the ninety respondents believed the Department 
of Education's commitment to teacher evaluation policy 
implementation to be weaker or were not sure or held no opinion. 
Administrator respondents held this perspective more often than 
did teacher respondents. 

At the local level superintendents perceive their school 
boards to be maintaining a high commitment to implementing 
teacher evaluation policy, v/ith 25 o£ the 30 jurisdictions 
sampled reporting a high commitment by their boards to 
implementation of teacher evaluation policy. Concern was 
expressed by the researcher that ten of the boards with a high 
commitment are not seen by their superintendents to be actively 
demonstrating this commitment and an additional five of the 
thirty school boards sampled are percieved to have moderate or 
low commitment and are also not actively expressing a commitment 



117 



105 



to implementation of teacher evaluation policy. The perception 
of many policy implementors that the Department of Education's 
commitment is declining could be reinforced by a perception that 
board commitment is also declining. 



Policy Effects 



The rpestion addressed here is whether the anticipated 
policy effects defined by the policy makers are congruent with 
the perceived policy effects of the policy implementors. This is 
question 6 of the statement of the problem defined in Chapter 
One. 

In the Phase I interviews respondents were asked, "What 
idealized policy, relationships, and goals would you hope for to 
enhance teacher evaluation policy implementation? " Analysis of 
the responses to this question revealed that ideal policy 
requirements needed to enhance implementation of teacher 
evaluation policy would include: 

1) more effective personnel resources t 

2) better liaison with the Alberta Teachers 1 
Association and universities regarding support 
structures; 

3) institutionalization of teacher evaluation with 
evaluation seen as a need versus a threat; 

4) increased resources, especially in small 
jurisdictions; 

5) more research and development on teacher 
evaluation processes; and, 

6) a clear focus on the improvement of teaching 
and resultant student learning. 

The former Minister of Education, Mr. King, had responded 

that he viewed teacher evaluation as accomplishing the 

elimination of incompetent teaching, improvement of the act of 
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teaching, improvement of the overall quality of teaching, and 
contributing to increased public confidence in the educational 
system. 

Phase II interviewees were asked "What would you look for in 
making a decision as to whether the policy has been successfully 
implemented in your jurisdiction?" Responses to this question 
are summarized in Table 16. Respondents in some cases identified 
more than one factor, so total responses exceed the number of 
respondents. 

A distinct dichotomy is evident in Table 16 between the 
responses of teachers versus administrators on the first four 
response categories, while large proportions of administrator 
respondents identified evidence teaching was improving, staff 
satisfaction/positive teacher attitude, and administrative 
commitment to evaluation as indicators of successful policy 
implementation, very few teacher respondents identified these 
factors. On the other hand, two-thirds of the teacher 
respondents stated that evaluations that were informative/useful 
to them would be indicative of successful teacher evaluation 
policy implementation, whereas few administrators suggested this 
factor. 
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Table 16 



Phase II Respondent Identified Indicators of Successful 
Implementation of Teacher Evaluation Policy 



Response 


Tchrs . 


Prins. 


Supts. 


Total 


Evidence teaching was 
improving 


3 


15 


16 


34 


Staff satisfaction; 
positive tchr. attitude 


4 


16 


12 


32 


Informative/useful 
evaluation 


20 


4 


3 


27 


Administrative commitment 
to evaluation 


0 


7 


12 


19 


Improvement of public 
confidence in education 


3 


3 


4 


10 


Clarity/consistency 
in evaluation criteria 


3 


5 


2 


10 


Evaluation skills enhanced; 
improved quality of 
evaluation 


0 


4 


5 


9 


Personnel decisions based 
on teacher evaluation 


0 


2 


4 


6 


Tchrs. feel evaluation 
is fair/iust 


3 


0 


o 




More peer/self evaluation 


1 


0 


1 


2 


Inservice planning informed 
by evaluation results 


0 


0 


2 


2 


Good liaison with central 
office 


0 


1 


0 


1 



note: Tchrs. ^Teachers, Prins. ^Principals, Supts. Superintendents, 
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A small but similar proportion from each respondent group 
suggested successful policy implementation would be indicated if 
public confidence in education was enhanced, and if the clarity 
and consistency in evaluation criteria were achieved. Nine 
administrator respondents also suggested enhancement of 
evaluation skills with resultant improvement in the quality of 
teacher evaluation, and six stated personnel decision making 
based on evaluation results would reflect successful teacher 
evaluation policy implementation. 

The remaining four items were mentioned by only one, two or 
three respondents and were not major themes in the current study, 
but are relevant indicators of successful teacher evaluation 
policy implementation cited in the literature (see Townsend, 
1984; Wise, et. al., 1985). 

Although many administrator respondents identified 
improvement of instruction as a?n indicator of successful 
implementation, most could specify only informal monitoring of 
this component as a means of determining if it was occurring. 

The policy implementors conceptualization of successful 
policy implementation is relatively congruent with the idealized 
policy intents identified by the policy makers. Teacher 
satisfaction with teacher evaluation, useful and informative 
evaluations, and administrative commitment to teacher evaluation 
suggested by policy implementors would all be indicative of the 
institutionalization of teacher evaluation policy which policy 
makers stated would be an ideal condition. King's objective of 
elimination of incompetent teaching and improvement of teaching 
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quality is congruent with the implementors' identification of 
evidence that teaching was improving as an indicator of 
successful policy implementation. The implementors 
identification of improvement of public confidence in education 
is identical to King's stated objective of "contributing to 
increased public confidence in the educational system". 

Numerous points of agreement appear to exist between the 
perspectives of policy makers and policy implementors regarding 
what ideal teacher evaluation policy implementation would be 
like. Granted, concensus likely does not exist on how to best 
achieve this idealized policy state, but the fact that multiple 
points of agreement exist between policy makers and implementors 
suggests that eventual full implementation of teachor evaluation 
policy is a reasonable objective. 

Expectations for Full Implementation 

In phase I interviews, policy makers were asked what their 
perceptions of the current status of teacher evaluation policy 
implementation were. Analysis of their responses indicated that 
policy makers did not believe teacher evaluation policy 
initiatives will dissipate; however, they also did not think that 
implementation is anywhere near complete. 

Administrative policy implementors in phase II interviews 
were asked, how many schools, if any, have implemented the 
teacher evaluation policy, either fully or partly in their 
jurisdictions. 
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Twenty-three principal and nineteen superintendent 
respondents stated teacher evaluation policy had been fully 
implemented in their jurisdiction, six of these forty-two 
respondents qualified their statement that "fully" meant in terms 
of the mechanics of the policy. That is, the policy standards 
were in place, but the policy effects, characteristics of the 
implementors, etc., may be yet lacking. 

Seven principal and 11 superintendent respondents stated 
teacher evaluation policy had been partially implemented in their 
jurisdiction. These respondents often cited implementation 
barriers, such as time, the newness of the policy, or the 
discomfort of principals with it as factors which had inhibited 
full implementation. 

The researcher was surprised that such a high proportion of 
respondents (42/60) were willing to characterize teacher 
evaluation policy as fully implemented, despite the fact that 
earlier questions in the interview identified areas where 
implementation barriers existed. Essentially, most administrator 
respondents seemed comfortable with a fairly superficial 
definition of full policy implementation. This may have been due 
to the mandatory nature of teacher evaluation policy 
implementation that the provincial policy makers created and the 
resultant pressure on implementors to demonstrate full 
implementation . 

Ironcially, the interviews with the policy makers revealed 
that they believed teacher evaluation policy to be in the process 
of implementation, but that full implementation was a longer term 
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process, and one that may require adjustments in terms of 
resources, characteristics of the implementing agencies, policy 
standards, etc., before full implementation could be expected. 

A communication gap seems to exist between the expectations 
of the policy makers and the policy implementors relative to a 
realistic timeline for full implementation of teacher evaluation 
policy. This question of full implementation and the realistic 
time frames and mechanisms required to achieve it is a topic 
which will require further dialogue between policy makers and 
implementors . 

Anticipated Future Needs 

Policy makers suggested that teacher evaluation in the 
future will likely require the creation of mechanisms that will 
provide for more teacher involvement in the evolution of teacher 
evaluation processes in Alberta. In addition, the expertise base 
and resources in support of teacher evaluation will need 
enhancement. Court cases questioning the expertise of evaluators 
and collective agreement negotiations focusing on teacher 
evaluation procedures might also be future forces shaping teacher 
evaluation in the province. 

All three levels of policy implementors were asked if there 
were any future needs, supports or adjustments which they thought 
might be necessary to assure that teacher evaluation has a 
positive influence in their school or jurisdiction. These 
responses are summarized in Table 17. Respondents may have 
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identified more than one factor; therefore, the number of 
responses exceed the number of respondents. 

Table 17 

Phase II Respondent Identified Future Needs, Supports 
or Adjustments Necessary for Successful Implementation 
of Teacher Evaluation Policy 

Response Tchrs. Prins. Supts. Total 



Evaluate teacher 
evaluation processes to 
improve it; improve evaluator 

skills-curricular knowledge 9 15 17 41 

Assure emphasis is 

on teacher improvement 11 14 12 37 

Periodic orientations for 
tchrs. to reduce cynicism 

and build trust 10 7 5 22 

More time allocated to 

evaluation process 2 11 7 20 

Support peer evaluation; 
develop master tchr concept 

or merit programs 4 2 6 12 

More regular evaluations 

than a 3-5 year cycle 6 10 7 

Standardize evaluation 

f rameworks 0 4 15 

Improve articulation of 

evaluation policies 12 2 5 

Improve due process with 

2nd or 3rd party experts 3 0 0 3 

Assure public is more 

aware of procedures 0 112 

Other* 0 0 2 2 

note: Tchrs. =Teachers, Prins. ^Principals, Supts. -Superintendents, 
* explained in text below 



125 

ERIC 



113 



The policy makers 1 perspectives that future requirements 
will involve increased expertise, resources, and teacher 
involvement are largely upheld by the perspectives of the policy 
imp lemen tors. The first response category and most frequently 
mentioned factor reported in Table 17 identifies the need for 
improved teacher evaluation expertise within the school 
jurisdictions. The third response category in Table 17, 
providing orientations for teachers, represents a mechanism by 
which teacher ownership of teacher evaluation policy may be 
increased. The fourth response category in Table 17, regarding 
more time, relates directly to the need for additional resources 
in support of teacher evaluation policy implementation and 
reinforces the findings presented earlier relative to the policy 
resources and disposition of the implementors variable clusters 
of the Van Horn and Van Meter (1977) policy implementation model. 
Principals identified the need for more time more frequently than 
teacher and superintendent respondents combined. These three 
response categories are similar to the future needs identified by 
policy makers. 

The second response category in Table 17, assuring teacher 
evaluation emphasizes teacher improvement, is a call by these 
respondents to maintain the focus of teacher evaluation on 
formative evaluation versus summative evaluation. This response 
is consistent with the finding reported earlier that policy 
intents at the jurisdictional level were primarily formative. 

Development of peer evaluation, master teachers or merit 
programs, noted by twelve respondents, are variations on the 
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desire for an emphasis on teacher improvement. Interestingly, 
six teacher respondents but only one administrator respondent 
suggested a future need for more regular evaluations for tenured 
teachers than the current three to five year cycle required by 
most jurisdictional policies. A need for standardized teacher 
evaluation frameworks was identified mainly by principal 
respondents. 

The need for articulation between evaluation policies refers 
to the five levels of evaluation (student, teacher, program, 
school and system evaluation) required by the Department of 
Education's Management and Finance Plan . 

"Other" needs noted in Table 17 were suggested by two 
superintendent respondents, and included need for: a provincial 
policy on administrator evaluation,* an expanded principals 1 role 
in summative evaluation, and concentrating evaluation on weak 
teachers. 

In summary, the scope and frequency of factors which were 
thought by respondents to be necessary for positive teacher 
evaluation policy outcomes present an outline for a specific 
needs assessment of teacher evaluation policy implementation at 
the local level • Provincial policy makers expressed awareness of 
the need for adjustments, and the needs identified here by policy 
implementors pinpoint the types of adjustments which may be 
required for ultimately successful implementation. 
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ggmmary conclusions 

The Disposition of the Implementors variable cluster of the 
Van Horn and Van Meter (1977) policy implementation model was 
discussed in Chapter Seven. In addition, the implementors 
perceptions of policy effects and anticipated future needs 
associated with the implementation of teacher evaluation policy 
in Alberta was presented and compared to the perceptions of the 
policy makers. 

Responses to questions regarding the disposition of the 
implementors indicated a substantial base of support for teacher 
evaluation policy by members of the teaching profession, but also 
the presence of a number of concerns, which if not addressed, 
could result in increasing resistance by teachers to 
implementation of teacher evaluation policy in Alberta. The most 
frequent source of resistance perceived by teachers, but largely 
missed by administrators, was subjective, insufficient ™ invalid 
bases of teacher evaluation. Other sources of resistance 
identified by all three respondent groups included the role of 
the principal relative to formative versus summative evaluation; 
the stress, anxiety and exhaustion associated with evaluation; 
and the unequal application of teacher evaluation across staffs. 

Interestingly, administrative respondents identified the 
stress/anxiety factor more often than the one teacher respondent 
who noted this phenomenon. Other sources of resistance were 
noted by only one or two respondents, but the responses do 
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identify potential sources of resistance by teachers and are 
therefore worthy of note by policy implementors as a potential 
problem area in a particular jurisdictional setting. 

In response to a question regarding administrator resistance 
to implementation, principal respondents, expressed their concern 
over time and inadequate resources twice as often as 
superintendent respondents. Teacher respondents identified this 
area as a problem for their principals almost as often as the 
principal respondents, lending credibility to the principal 
respondents' concerns. The fact that this problem is identified 
by so many respondents argues for implementation strategies at 
all levels that confront this concern directly in order to remove 
it as a real or perceptual barrier to successful implementation 
of teacher evaluation policy. 

Teacher and principal respondent categories also exhibited 
close agreement in terms of the numbers of responses relative to 
the need for evaluators to have more training and an improved 
empirical basis for evaluation, and to the existence of role 
confusion between summative and formative evaluative efforts and 
the lack of direction with respect to the overall teacher 
evaluation processes. 

Twenty-five of ninety respondents, primarily superintendents 
and teachers, indicated administrators had no problem with 
implementation. Only five of the thirty principal respondents 
indicated no problem? with teacher evaluation policy 
implementation. 
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Numerous points of agreement appear to exist between the 
perspectives of policy makers and policy implementors regarding 
what ideal or successful teacher evaluation policy implementation 
would be like. Concensus regarding how to best achieve this 
idealized policy may not exist, but the fact that multiple points 
of agreement between policy makers and implementors were 
identified suggests that eventual full implementation of teacher 
evaluation policy is a reasonable objective. Teacher 
satisfaction with teacher evaluation, useful and informative 
evaluations, and administrative commitment to teacher evaluation 
suggested by policy implementors as indicative of successful 
Implementation, would all be evidence of the institutionalization 
of teacher evaluation policy which policy makers stated would be 
an ideal condition. King's objective of elimination of 
incompetent teaching and improvement of teaching quality is 
congruent with the implementors 1 identification of evidence that 
teaching was improving as an indicator of successful policy 
Implementation. The implementors identification of improvement 
of public confidence in education is identical to King's stated 
objective of "contributing to increased public confidence in the 
educational system" . 

Interviews with the policy makers revealed that they 
believed teacher evaluation policy was in the process of 
implementation, but that full implementation was a longer torm 
process, and one that may require adjustments in terms of 
resources, characteristics of the implementing agencies, policy 
standards, etc., before full implementation could be expected. 
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However, most administrator respondents seemed comfortable with a 
fairly superficial definition of full policy implementation. 
This may have been due to the mandatory nature of teacher 
evaluation policy implementation that the provincial policy 
makers created and the resultant pressure on implementors to 
demonstrate full implementation. 

A communication gap seems to exist between the expectations 
of the policy makers and the policy implementors relative to a 
realistic timeline for full implementation of teacher evaluation 
policy. This question of full implementation and the realistic 
time frame * and mechanisms required to achieve it, is a topic 
which will require further dialogue between policy makers and 
implementors. 

The policy makers 1 perspectives that future requirements 
will involve increased expertise, resources, and teacher 
involvement are largely upheld by the perspectives of the policy 
implementors. 

The scope and frequency of factors which were thought by 
respondents to be necessary for positive teacher evaluation 
policy outcomes in the future present an outline for a needs 
assessment of teacher evaluation policy implementation at the 
local level. Provincial policy makers expressed awareness of the 
need for adjustments, and the needs identified here by policy 
implementors pinpoint the types of adjustments which may be 
required for ultimately successful implementation. 
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CHAPTER EIGHT 

Analysis of Policy Documents and Evaluation Instruments 
Introduction 

The research question assessed in Chapter Eight investigates 
the similarities and differences evident in Alberta school 
jurisdictions' teacher evaluation policies and instruments, and 
whether the written teacher evaluation policies and instruments 
are supported by the study findings. 

Policy Documents Analysis 

Policy documents were analyzed using a content analysis 
procedure whereby the policy documents were first overviewed for 
the purpose of defining common general categories. A second 
level of analysis was then carried out whereby each policy 
document was meticulously analyzed to define policy document 
content relative to the general categories identified in the 
first level analysis. 

The general categories defined by the first level of 
analysis include: 

1) underlying philosophy, 

2 ) purpose/ intents , 

3) role responsibilities, 
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4) guidelines and procedures, 

5) appeal procedures. 

Each general category will be presented separately* 



Underlying Philosophy 



Five sub-categories relative to the underlying philosophy 
emerged and are summarized in Table 18. 

Table 18 

Underlying Philosophies Identified in the 
Analysis of Policy Documents 



Sub-category n per cent* 

Total jurisdictions with 
a statement of underlying 

philosophy 23 77 

Evaluation crucial/a 

board priority 14 47 

Evaluation as a 

positive process 12 40 

Teacher's right to know 
a common evaluation 

criteria 7 23 

Theological basis for 

evaluation 6 20 

Teacher's right to a 

written evaluation 4 13 

Grounded to the nearest per cent ~~ " ~~ — — 



Seventy-seven per cent of the jurisdictions 1 policy 
documents opened with a preamble which defined the jurisdictions 
philosophy relative to teacher evaluation policy. Fourteen or 
forty-seven per cent of the documents contained a statement that 
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evaluation was a crucial process or was an important priority to 
the school board. Twelve documents or forty per cent noted that 
teacher evaluation was intended to be a positive process based on 
such concepts as trust, respect, etc. Seven jurisdictions noted 
that teacher evaluation is based, partly at least, on the 
teacher's right to a common evaluation criteria, and four 
jurisdictions stated the teacher's right to a written evaluation 
of their professional performance. Lastly, six of the seven 
Catholic Separate School Districts sampled included reference to 
the theological basis for teacher evaluation based on Christian 
values, such as love as exemplified in the teachings of Christ. 

Although a philosophical statement advocating prioritization 
of implementation or a positive implementation environment cannot 
guarantee that such processes actually occur, statements 
advocating processes such as these are desirable. Besides 
defining the underlying philosophy, such statements clarify the 
local jurisdictions' policy standards and thereby support the 
policy intents which local policy implementors are responsible 
for carrying out. The fact that local implementors perceived 
policy intents at the local l^vel to be more formative than 
provincial policy intents may be duo in part to the fact that 
local policy documents explicate intents more throughly through 
the underlying philosophies examined above. 
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Policy Purpose and intents 

Twelve sub-categories relative to purpose and intents were 
identified and are summarized in Table 19. 



Table 19 

Purposes and Intents Identified in the 
Analysis of Policy Documents 



Sub-category 


n 


per cent* 


Improve instruction 


30 


100 


Personnel 


decisions 


20 


67 


Continous 


contract 


17 


57 


Permanent 


certification 


17 


57 


Professional development 


16 


53 


Affirm/support the teacher 


16 


53 


Formative 


purposes defined 


16 


53 


Summative 


purposes defined 


16 


53 


Promotion 




14 


47 


Dismissal 




13 


43 


Transfer 




12 


40 


Inservice 


needs assessment 


3 


10 


♦rounded to the 


nearest per cent 







All of the jurisdictions 1 policy documents identified improvement 
of instruction as a policy intent which is congruent with 
provincial policy intents defined in the Program Policy Manual 
(1984:72) which states, 



The performance of individual teachers and the quality 

of teaching practices across the province will be evaluated 

to assist in the provision of effective instruction to 
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students and in the professional growth and development of 
teachers. 

There is less congruence between local policy d ^nents and 
provincial policy intents with respect to the professional growth 
and development of teachers. Only sixteen or fifty-three per 
cent of the policy documents mentioned teacher professional 
development specifically as a policy intent. Sixteen documents 
also noted affirmation, reinforcement or support for teachers as 
a policy intent or purpose* 

Personnel decisions were mentioned more frequently as a 
policy intent by sixty-seven per cent of the jurisdictions • 
Seventeen, or fifty-seven per cent, of the jurisdictions noted 
continuous contract decisions or permanent certification 
decisions as a purpose of teacher evaluation. Promotion, 
dismissal and transfer personnel decisions were stated in 
forty-seven per cent, forty-three per cent and forty per cent of 
the policy documents respectively. It is clear that, in terms of 
the content of the policy documents, personnel decision making 
as a function of teadier evaluation is a more important purpose 
than professional development of teachers. 

Slightly more than half of the documents or fifty-three per 
cent contained explicit clarification of formative versus 
suanmative evaluation purposes. Lastly, only three jurisdi Mons 
linked teacher evaluation purposes to clarification of teacher 
inservice needs within the policy documents. 
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Role Responsibilities 

Role responsibilities refer to role descriptions of 
personnel assigned specific duties within teacher evaluation 
policy documents* Superintendents and principals are most often 
identified as having specific role responsiblities in the policy 
documents. Twenty-four documents delineate superintendent 
responsibilities specifically, and twenty-five documents define 
principal responsibilities. Assistant superintendent roles are 
defined in sixteen documents, and six documents define roles for 
vice-principals specifically. 

Interestingly, only five documents defined roles of teachers 
relative to teacher evaluation, and three documents refer to 
school board members roles. The relative absence of teacher role 
responsibilities in policy documents may present an area where 
jurisdictions may \*ish to review need for future adaptation of 
current policy documents and may provide an avenue to provide for 
greater teacher ownership of teacher evaluation policy. 

Policy documents that did not contain specific explication 
of personnel role responsibilities generally relied on implicit 
role delineation. Such documents might be reviewed by 
jurisdictional staff to determine whether personnel role 
responsibilities have been adequately understood in these 
jurisdictions. 
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Guidelines and Procedures 

Guidelines and procedures represent the largest amount of 
policy content in terms of the number of sub-categories and are 
summarized in Tables 20 and 21. 

Table 20 

Guidelines and Procedures Identified in the 
Analysis of Policy Documents 



Sub-category 


n 


per cent* 


Disposition of reports 


27 


90 






77 


Post— conference sucraested 


2 


7 


Evaluation criteria specified 


21 


70 


Teacher role expectations 






specified 


3 


10 


Access to reports specified 


21 


70 


Self-evaluation encouraged 


19 


63 


Peer evaluation encouraged 


14 


47 


Remedial process specified 


12 


40 


Evaluation instruments specified 


11 


37 


Pre-conference required 


3 


10 


Pre-conference suggested 


7 


23 


Evaluation time specified 


9 


30 


Unannounced visits permitted 


5 


17 


Unannounced visits prohibited 


1 


3 



♦rounded to the nearest per cent 
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Table 21 



Staff Evaluation Schedules Identified in the 
Analysis of Policy Documents 



Sub— cateaorv 


xi 




Teachers on temporary contract 






Annually 


10 


33 


C otn "1 ■annual 1 \r 
Tt*t —annual Iv 

111 QlHlUuXXJr 




i n 


D 


<s u 


Mnrp fhan +"T*i -»anvma1 1 v 

HUL CZ l*lldll l*X X ClllilUClX X jr 


0 


1 / 


Tenured with interim certificates 






Annually 


17 


57 


Semi-annually 


12 


40 


Tri-annually 


0 


0 


More than tri-annually 


1 


3 


Tenured with permanent certificates 






Annually 


3 


10 


Every two years 


4 


13 


Every three years 


12 


40 


More than every three years 


11 


37 



*rounded to the nearest per cent 



Ninety per cent of the policy documents specify the 
procedures to be followed in the disposition of teacher 
evaluation reports (i.e. wh» re reports are to be filed). 
Twenty-one jurisdictions or seventy per cent also specify 
procedures to be followed in gaining access to evaluation reports 
once they are on file. There is some variation within this 
category regarding levels of specificity, with some documents 
specifying teacher access only while other documents elaborate 
who else may have access to teacher evaluation files and under 
what conditions. 

Twenty-five jurisdictions or 83 per cent of the sample 
specify in their policy documents that post-evaluation 
conferences either must be held or should be held. Seventy-seven 
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per cent of the jurisdictions place a strong emphasis on 
post-conferencing by mandating it in their policies, 

Pre-conf erencing, a key component of clinical supervision, 
receives much less emphasis in the policy documents. Only three 
jurisdictions or ten per cent require pre-conf erences, and an 
additional seven jurisdictions or 23 per cent suggest its use. 

Also important to local policy writers were the inclusion of 
either specific evaluation criteria or more general teacher role 
expectations as a guide to what teacher evaluation will focus on. 
Twenty-four of the thirty policy documents sampled included such 
criteria. 

Self-evaluation and/or peer evaluation were encouraged by 
nineteen and fourteen of the jurisdictions respectively. These 
two concepts were closely related. In only one case was peer 
evaluation advocated without a concomitant reference to 
self -evaluation. 

Twelve jurisdictions elaborated within their policy 
documents what form a remedial process should take in the event a 
teacher received an evaluation indicative of teacher weaknesses. 
The specific teacher evaluation instrument to be used was 
dictated in policy by eleven jurisdictions. 

Evaluation time specification refers to when in the school 
year evaluation should occur. Nine jurisdictions included such 
specifications in the policy documents. 

As an indication of local variations in teacher evaluation 
sensitivities, five jurisdictions explicitly stated the 
permissibility of unannounced visits by evaluators to teachers' 
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classrooms and one jurisdiction specifically prohibited such 
evaluations. 

Guidelines and procedures universally addressed the times 
that evaluations should occur for staff of varying employment 
classifications. These data are presented in Table 21. 

Teachers who are new to a jurisdiction and on temporary 
contract receive the most intense level of formal teacher 
evaluation under current policies, with sixty-seven per cent of 
the policy documents requiring two, three or more formal 
evaluations in the first year of teaching. 

Tenured teachers holding interim certificates, and who after 
two years of teaching are eligible for permanent certification, 
receive a comparatively moderate level of scrutiny under present 
teacher evaluation policies, with one hundred per cent of the 
policies requiring one, two, or more formal evaluations to 
support recommendations for permanent certification. 

Tenured teachers holding permanent certification receive 
comparatively minimal levels of evaluation. In fact, 
seventy-seven per cent of the jurisdictional policies require 
tenured, permanently certified teachers to be evaluated only once 
every three to five years. During the phase II interviews with 
teachers, two respondents commented that teacher evaluation was 
viewed by tenured teachers as a non-issue primarily affecting the 
ncn-t enured staff. These figures help explain why these two 
interviewees held this point of view. 

Alberta Education (1980:13) reported the results of a survey 
of certificated staff evaluation practices in Alberta and 
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compared the results of the 1980 survey with a similar survey 
reported by Holdaway in 1977. These data indicated that tenured 
teachers were evaluated annually by only six per cent of Alberta 
school jurisdictions in 1977 and by eleven per cent in 1980. 
This compares to the 10 per cent of jurisdictions who require 
annual evaluation of tenured staff in 19<37. Apparently the 
teacher evaluation policy mandates of the Alberta Department of 
Education have not substantially altered the practices of Alberta 
school jurisdictions relative to che evaluation of tenured 
teachers. 

The same survey of Alberta Education (1980:13) reported that 
untenured teachers, either first year or new to the system, were 
evaluated annually by ninety per cent of Alberta school 
jurisdictions. Teacher evaluation policies in 1987 require 
annual evaluation of untenured teachers in thirty-three per cent 
of the jurisdictions and two or more evaluations a year in 
sixty-seven per cent of the jurisdictions. These figures 
indicate that mandated teacher evaluation by the Alberta 
Department of Education has been interpreted at the local level 
to mean that untenured teachers should receive the primary 
emphasis under the policy initiatives of the Department. 
However, the two policy goals stated by the Department of 
Education; that of improving instruction and assuring the 
professional development of teachers, does not necessarily 
suggest an inordinate emphasis of teacher evaluation on untenured 
staff. 
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Appeal Procedures 

Appeal procedures were the one clear policy standard which 
the Alberta Department of Education required local school 
jurisdictions to include in their teacher evaluation policy 
documents. Each jurisdiction was required to submit their 
teacher evaluation policy document to one of five Regional 
Offices of Education in the province for review, presumably to 
assure that appeal procedures were included. 

The thirty teacher evaluation policy documents were analyzed 
to determine the structure of the appeal process and these 
results are summarized in Table 22. 

Table 22 

Appeal Procedures identified in the 
Analysis of Policy Documents 

Sub-category n per cent* 



Appeal Levels 



First -evaluator 

-asst. superintendent 
-superintendent 
-school board/supt. 


9 
2 
15 
1 


30 
7 

50 
3 


Second -superintendent 
-school board 


10 

.9 


33 
30 


Third -school board 


8 


27 


Appeal timelines specified 


20 


67 


Appeal basis specified 


8 


27 


Identifies provincial/federal 
appeal options 


5 


17 


No appeal process 


3 


10 



♦rounded to the nearest per cent 

note: asst.=assistant, supt.=superintendent 
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Notable divergence was evident between policy documents 
regarding the first level of appeal. Half of the policies 
specified the superintendent as the first level of appeal, but 
thirty per cent identified the evaluator who authored the 
contentious report to be the first level of appeal. Larger 
systems with more specialized central office staffing structures 
specified the assistant superintendent as the first level of 
appeal in two jurisdictions. The school board was identified as 
a first level appeal in one jurisdiction, but for procedural 
appeals only; matters of substance were to be appealed to the 
superintendent in this jurisdiction. 

Second level appeals were directed to superintendents or the 
school board and in districts where the superintendent was the 
second level of appeal, the board was left as the third level of 
appeal in eight jurisdictions or no third level was specified. 

Levels of appeal are in many instances a function of the 
size of the district. For example, in small jurisdictions* where 
the superintendent is heavily involved in direct evaluation of 
teachers, there is little recourse within the structure of the 
jurisdiction but to have the school board act as the appeal 
mechanism after the superintendent. Other alternatives, however, 
may be available outside of the jurisdictions 1 organizational 
structure. For example, appeal bodies made up of senior 
administrators in a region, or of education professionals hired 
on a contract basis are two possible alternatives. The fact that 
few appeals have arisen, as noted in the phase II interview 
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results, suggest that various alternatives to overly parochial 
appeal structures may be needed in the future. 

Appeal timelines were specified in two-thirds of the policy 
documents. Timelimes are useful for all parties in an appeal 
process in eliminating uncertainty regarding when specific 
actions must be taken in order to maintain ones right to appeal. 
Policy documents lacking such detail should be updated to correct 
this deficiency. 

Few policy documents specified the bases of appeal. Most 
policies were simply silent regarding under what circumstances an 
appeal might be launched. Policy documents that did specify 
grounds usually identified the circumstance of a teacher 
disagreeing with the content or conclusions of an evaluation 
report. One policy distinguished between process and substance 
grounds for appeal. The question of how specific and what 
details should be included in the appeal procedures provides an 
opportunity for further review and adjustment of policy documents 
within jurisdictions and again may provide a mechanism by which 
teachers can attain a greater ownership of the teacher evaluation 
policies. 

Only five policy documents identified the existence of 
provincial or federal legislation which might be available to 
support an appeal beyond the appeal procedures available to a 
teacher within their jurisdiction. 

Lastly, three of the thirty policy documents contained no 
appeal process despite the policy standards of the Department of 
Education. One of the three notes the possibility of appeal 
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without specifying any details regarding procedures. The other 
tvo policy documents were written in 1983, before the 
Departmental appeal requirement, and one of these two policy 
documents was in the process of revision at the time this study 
vas conducted. 

Policy Documents Analysis Summary 

The greatest similarities among the thirty policy documents 
analyzed in this chapter involved the policy intent of improving 
instruction and the specification of evaluation schedules 
relative to a teachers employee status. These were the only 
content areas where all thirty policy documents universally 
addressed. Most policies also addressed the disposition of 
reports. 

Moderate similarites, where between forty to eighty-five per 
cent of th\ documents concurred, included the policy intents of: 
personnel decisions, continents contract decisions, promotion, 
transfer and dismissal decisions, permanent certification 
decisions, af f nidation or reinforcement of the teacher, and 
professional improvement. Formative and summative evaluation was 
defined in just over half of the documents and the roles of 
superintendents and principals were defined in eighty and 
eighty-three per cent of the policies respectively. Procedures 
for assisting teachers in difficulty or remedial processes were 
identified in sixty per cent of the documents. Self -evaluation 
and peer evaluation was encouraged in sixty-three per cent of the 
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documents and post-conferences were required or suggested in 
eighty-three per cent of the policies. Teacher role expectations 
or the specific evaluation criteria were identified in eighty per 
cent of the policy documents. 

Appeal procedures were present in most policies and in the 
three that excluded appeal procedures, one stated the possibility 
of appeal and another policy document was in the process of 
revision. Appeal procedures, however, demonstrated a marked lack 
of similarity with eighty per cent of the documents specifying 
appeal timelines, and only twenty-seven per cent explicitly 
stating the bases of appeal. Few documents identified provincial 
or federal appeal options which may exist outsiae the local 
appeal procedures, such as is defined in the Alberta school Act. 

Minimal similarities existed among policy documents 
regarding: teachers' right to known, common evaluation criteria; 
the relationship of teacher evaluation to assessing 
jurisdictional inservice needs; roles of teachers within the 
evaluation process; and pre-conferencing requirements. 

These minimally and moderately prevalent items within the 
policy documents represent potentially useful additions to policy 
documents whi^h lack them, and as such offer a useful framework 
for future policy review by jurisdictional staff. 

Policy requirements for mandatory evaluation of permanently 
certified, tenured teachers does not vary significantly from 
figures reported in a 1980 survey of teacher evaluation practices 
in Alberta (Alberta Education, \980: 13). 



0 

ERJC 



147 



135 



Teacher Evaluation Instruments 

Evaluation instruments were analyzed to determine the 
similarities and differences that existed between jurisdictions* 
As noted above, eleven teacher evaluation policies mandate the 
use of a specific instrument* These instruments were collected 
as were instruments in use by evaluative personnel in the 
remaining jurisdictions which did not specify evaluation 
instruments in policy. 

The results of the analysis of evaluation instruments is 
presented in Tables 23 and 24. 

Table 23 



Teacher Evaluation Instrument Formats Identified in the 
Analysis of Evaluation Instruments 



Sub-category 


n 


per cent* 


Rating scales and anecdotal 


15 


50 


Anecdotal - with criteria 


9 


30 


Anecdotal - no criteria 


3 


10 


Evaluators choice 


2 


7 


Rating scales 


1 


3 



* rounded to the nearest per cent 
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Table 24 



Teacher Evaluation Instrument 
Identified in the Analysis of 


Structures 
Evaluation 


and Contents 
Instruments 


Sub-category 


n 


per cent* 


Teacher signature required 


16 


53 


Consolidated/summary report 


7 


23 


Evaluation purpose indicated 


7 


23 


Appeal route stated on form 


3 


10 




o 
z 


7 


Pre/post conference detailed 


2 


7 


Rating scale defined 


2 


7 


Policy/philosophy stated 


2 


7 



* rounded to the nearest per cent 



Anecdotal or open ended formats are *.equently used in 
evaluating teachers in Alberta with such formats being used in 
conjunction with evaluation criteria or rating scales in at least 
ninety per cent of the jurisdictions sampled. 

Teacher evaluation instruments were further analyzed to 
compare the internal structure and content. This* analysis is 
summarized in Table 24. 

A high degree of similarity between teacher evaluation 
instruments may not necessarily be desirable if the evaluation 
purposes are tailored to meet unique needs within a particular 
school jurisdiction. The analysis summarized in Table 24, 
however, does point out a marked degree of divergence in internal 
structure between the teacher evaluation instruments in use by 
Alberta school jurisdictions. Several of these categories 
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represent potentially useful additions to evaluation instruments 
which currently lack them. 

Twenty policy documents mandate teacher signatures as an 
indication that the individual teacher has seen and/or discussed 
the results of the evaluation. However, only sixteen of the 
evaluation instruments provide for this policy requirement. 

Consolidated or summary reports, useful in focusing the 
evaluation results, and evaluation purposes, useful in clarifying 
the objectives of an evaluation, are incli- " ^ in twenty-three per 
cent cf the instruments. 

Few instruments included a statement about the appeal 
process. This item would be useful since many teachers may not 
have ready access to the appeal procedures defined in teacher 
evaluation policy documents. Few instruments included teacher 
role expectations; however, many instruments included evaluation 
criteria which accomplishes the same objective of clarifying the 
criteria on which teachers are evaluated. 

Post conferences are required by most jurisdictions , but 
details regarding such conferences are included on only seven per 
cent of the evaluation instruments. Rating scales are included 
in half of the instruments, but are defined in only seven per 
cent of the instruments. Underlying philosophies are clarified 
in nearly half of the policy documents analyzed, but again such 
statements are present in just seven per cent of evaluation 
instruments. 

Creation of a universal teacher evaluation instrument is 
certainly not advocated. However, review of evaluation 
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instruments by jurisdictional staff using the categories noted in 
Table 24 as a guide is suggested to assure that evaluation 
instruments are as comprehensive and detailed as is possible and 
desirable. 

Congruence with Policy ^implementation 

Phase II interview analysis demonstrated that the most 
frequently perceived policy intents at the local level were 
improvement of instruction, board accountability , and personnel 
decisions. The policy intent of enhancing the teaching 
profession, that is, providing for professional development, was 
not perceived as a policy intent by policy implementors at either 
the provincial or the local level. 

Analysis of policy documents demonstrated that one hundred 
per cent of the documents specified the policy intent of 
improving instruction but only fifty-three per cent specified the 
intent of professional development. Provincial policy (Alberta 
Education, 1984b: 72) specifically identifies the intent of 
M . • .professional growth and development of teachers." The 
almost total absence of this intent in the perception of policy 
implementors and in almost half of the policy documents 
represents an area in need of review by both policy makers and 
policy implementors. 

Policy implementors were asked during phase II interviews if 
policy expectations were clear with respect to their role 
responsibilities. Administrator respondents expressed little 
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confusion regarding their policy related responsibilities. 
Teachers, however, were the least clear regarding their teacher 
evaluation role responsibilities. The policy documents analysis 
revealed that superintendents and principals are most often 
identified as having specific role responsibilities. On the 
other hand, teachers 1 roles relative to teacher evaluation policy 
is addressed in only seventeen per cent of the policy documents. 
Inclusion of teacher role responsbililities in teacher evaluation 
documents would likely help to rectify this problem. 

Lastly, policy implementors were asked if they were 
satisfied with the methods used to measure teacher performance. 
The strongest single theme to emerge from this question was the 
preference expressed by many respondents for anecdotal evaluation 
reporting formats. The analysis of teacher evaluation documents 
found that anecdotal formats, used either independently or in 
conjuction with rating scales, occured in at least ninety per 
cent of the jurisdictions sampled. Use of anecdotal formats, 
identified as commonplace currently, should continue. 

Summary and Conclusions 

The greatest similarities between the thirty policy 
documents analyzed in this chapter involved the policy intent of 
improving instruction and the specification of evaluation 
schedules relative to a teacher's employee status. 

Moderate similarites, where between forty to eighty-five per 
cent of the documents concurred, included the policy intents of: 
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personnel decisions, continous contract decisions, promotion, 
transfer and dismissal decisions, permanent certification 
decisions, affirmation or reinforcement of the teacher, and 
professional improvement. Formative and summative evaluation was 
defined in just over half of the documents and the roles of 
superintendents and principals were defined in eighty and 
eighty-three per cent of the policies respectively. Procedures 
for assisting teachers in difficulty or remedial processes were 
identified in sixty per cent of the documents. Self-evaluation 
and peer evaluation was encouraged in sixty-three per cent of the 
documents and post-conferences were required or suggested in 
eighty-three per cent of the policies. Teacher role expectations 
or the specific evaluation criteria were identified in eighty per 
cent of the policy documents. 

Appeal procedures were present in most policies. Appeal 
procedures, however, demonstrated a marked lack of similarity 
with eighty per cent of the documents specifying appeal 
timelines, and only twenty-seven per cent explicitly stating the 
bases of appeal. Few documents identified provincial or federal 
appeal options which may exist outside the local appeal 
procedures, such as is defined in the Alberta School Act. 

Minimal similarities existed between policy documents 
regarding: teachers 1 right to known, common evaluation criteria; 
the relationship of teacher evaluation to assessing 
jurisdictional inservice needs; roles of teachers within the 
evaluation process; and pre-conferencing requirements. 
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Minimally and moderately prevalent items within the policy 
documents represent potentially useful additions to policy 
documents which lack them, and as such offer a useful framework 
for future policy review by jurisdictional staff. 

Policy requirements for mandatory evaluation of permanently 
certified, tenured teachers does not differ markedly from figures 
reported in a 1980 survey of teacher evaluation practices in 
Alberta (Alberta Education, 1980:13). 

Evaluation instruments were also analyzed to determine the 
similarities and differences that existed between jurisdictions 
and to compare the internal structure and content of the 
instruments. A marked degree of divergence in internal structure 
between the teacher evaluation instruments in use by Alberta 
school jurisdictions was identified. Several of these categories 
represent potentially useful additions to evaluation instruments 
which currently lack them. 

Consolidated or summary reports, useful in focusing the 
evaluation results, and evaluation purposes, useful in clarifying 
the objectives of an evaluation, are included in twenty-three per 
cent of the instruments. Few instruments included a statement 
about the appeal process. This item would be useful since many 
teachers may not have ready access to the appeal procedures 
defined in teacher evaluation policy documents. Post conferences 
are required by most jurisdictions, but details regarding such 
conferences are included on only seven per cent of the evaluation 
instruments. F.ating scales are included in half of the 
instruments, but are defined in only seven per cent of the 
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instruments. Unc^rlying philosophies are clarified in nearly 
half of the policy documents analyzed, but again such statements 
are present in just seven per cent of evaluation instruments. 

Creation of a universal teacher evaluation instrument was 
not suggested; however, review of evaluation instruments by 
jurisdictional staff, using the categories noted above, is 
suggested to assure that evaluation instruments are as 
comprehensive as desired. 

Congruence between teacher evaluation policy implementation 
findings and policy documents and evaluation instruments was 
reviewed relative to policy intents, role responsibilities and 
preferred evaluation instrument formats. Analysis of policy 
documents demonstrated that one hundred per cent of the documents 
specified the policy intent of improving instruction but only 
fifty-three per cent specified the intent of professional 
development. The almost total absence of this intent in the 
perception of policy implementors anu in almost half of the 
policy documents represents an area in need of review by both 
policy makers and policy implementors. 

Superintendents and principals are most often identified as 
having specific role responsibilities; however, teachers 1 roles 
relative to teacher evaluation policy is addressed in only 
seventeen per cent of the policy documents. Inclusion of teacher 
role responsbililities in teacher evaluation policy documents 
would help to rectify these ambiguities. 

Lastly, policy implementors were asked if they were 
satisfied with the methods used to measure teacher performance. 
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The strongest single theme to emerge from this question was the 
preference expressed by many respondents for anecdotal evaluation 
reporting formats. The analysis of teacher evaluation documents 
found that anecdotal formats , used either independently or in 
conjuction with rating scales, occured in at least ninety per 
cent of the jurisdictions sampled. Use of anecdotal formats, 
identified as commonplace currently, should continue. 
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CHAPTER NINE 



Summary, Conclusions and Implications 

Introduction 

A summary of the purposes and procedures of the study, 
conclusions, and implications for theory, practice and further 
research are presented in Chapter Nine. 

Summary of the study 

This study investigated the degree of teacher evaluation 
policy implementation in Alberta. The essential questions and 
sub-questions addressed were as follows: 

1. What events affected teacher evaluation policy adoption 
and implementation in Alberta? 

a. What were the policy intents held by the policy 

makers? 

b. What social structures or informal networks 
affected the policy process? 

c. What were the anticipated ideal policy intents of 
the policy makers? 

d. What were the perceptions of policy makers of the 
current status and possible future outcomes of teacher evaluation 
policy? 

2. What were the percevied policy intents held by policy 
iaplementors and were perceptions of intents between policy 
makers and implementors congruent? 

3. To what degree have policy standards and resources 
affected teacher evaluation policy implementation? 

4. To what degree have communications, enforcements, 
characteristics of the implementing agencies, political 
environment, and socio-economic environment variables affected 
teacher evaluation policy implementation? 
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5. To what degree has the disposition of implemeuuors 
affected policy implementation? 

6. What were the policy effects perceived by policy 
implementors and were perceptions of effects between policy 
makers and implementors congruent? 

7. How similar were the expectations of policy makers and 
implementors for full implementation of teacher evaluation 
policy? 

8. What future adjustments to teacher evaluation policy 
implementation were perceived to be needed by policy makers and 
policy implementors? 

9. What were the similarities and differences evident in 
Alberta school jurisdiction's teacher evaluation policies and 
instruments, and were the written teacher evaluation policies and 
instruments supported by the study findings? 



Research Design and Methodology 

This study employed a descriptive survey design or what Dunn 
(1981:297) describes as a "case survey" which involves procedures 
to identify and analyze factors that account for variations in 
the implementation of policies. This method required the 
researcher to first develop a case coding scheme of categories 
that captured key components of policy inputs and processes. 

The information required for the study was secured through 
interviews and documents analysis. The first phase of the study 
was primarily qualitative, using semi-structured interviews with 
selected key decision makers and leaders in teacher evaluation in 
Alberta. Snowball sampling with key leaders and decision makers 
was used to identify this sample, that is, the first person 
interviewed, a former Minister of Education for Alberta, was 
asked to recommend others (Bogdan and Biklen, 1982:66). 
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Interview transcripts from phase I were typed and returned 
to interviewees who were asked to review the transcript for any 
errors or misinterpretations* Coding procedures recommended by 
Bogdan and Biklen (1982:158) guided the structure and analysis of 
these interview protocols. 

Phase II interview schedules were constructed to solicit 
responses from the policy implementors, that is, teachers, 
principals and superintendents or their designates regarding 
their parcept'ons of teacher evaluation policy implementation. 
Phase II interview schedules were determined by findings from 
phase I interviews with policy makers and by the variable 
clusters identified in the van Horn and Van Meter (1977) policy 
implementation model. 

Initial drafts of the interview schedules were reviewed for 
face validity by two doctoral students and three professors in 
the Department of Educational Administration at the University of 
Alberta. The second draft versions of the interview schedules 
were then subjected to pilot testing in the field through 
simulated interviews with two assistant superintendents, two 
principals and two teachers. This pilot testing was intended to 
eliminate any terms which were vague or ambiguous, and to improve 
construct validity by eliciting respondents perceptions of the 
degree of comprehensiveness represented by the interview 
schedules relative to teacher evaluation policy implementation. 
Final adjustments were made to the interview schedules based on 
the pilot interviews and these revised interview schedules were 
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used in conducting phase II interviews. The interview schedules 
are presented in Appendices A through C. 

Within the context of the phase II interviews, if any 
confusion or ambiguity seemed to bo present at any point in the 
interview, the researcher confirmed the interviewee's reponse 
with the interviewee. 

The field-based, structured interviews permitted the 
researcher to experience more in-depth analysis of teacher 
evaluation policy implementation with practitioners in the field 
than would have been possible through quantitative, closed-ended 
survey research methodology. 

Phase II interview interpretation involved a qualitative 
analysis to identify themes and patterns of reponses in 
relationship to the research questions and the Van Horn and Van 
Meter (1977) policy implementation model. 

Thirty of 146 active Alberta school jurisdictions were 
randomly selected from the Alberta School Jurisdiction List, 1986 
for inclusion in this study. In order to assure a representative 
sample of jurisdictions, the population of jurisdictions was 
stratified on the basis of type of jurisdiction and geographic 
zone. Jurisdictions were then selected from each stratified 
grouping using a random numbers table. 

Letters requesting each jurisdiction^ participation in the 
study were posted on September 5, 1986. A copy of this 
correspondence is presented in Appendix D. Five of the thirty 
jurisdictions initially contacted declined involvement in the 
study on the basis of over-involvement with research studies or 
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simply being too busy to participate. Alternative jurisdictions 
randomly selected within the same stratified grouping were 
subsequently contacted and all agreed to participate. Within 
each of the thirty jurisdictions, interviews were arranged with 
the superintendent or designate and a principal and a teacher 
randomly choosen from the jurisdictions staff list. The 
principal and teacher respondents were selected from the same 
school. The ninety phase II interviews began on October 28, 1986 
and were completed on February 23, 1987. 

School district teacher evaluation policy documents, obtained 
from each sampled jurisdiction, were studied using a content 
analysis procedure. In addition, school administrators 
interviewed were asked for copies of teacher evaluation 
instruments (recording/reporting forms) which they used for 
teacher evaluation. A content analysis of these instruments was 
completed and is reported in Chapter Eight. 

Conditions Affecting Policy Adoption 

Among senior management in the Department of Education there 

teacher evaluation policy. All respondents within the Department 
concurred with the focus on improvement of instruction, while 
many also saw it as a mechanism to improve teacher 
professionalism. One Assistant Deputy Minister stated it was a 
means of demonstrating accountability to the public. The 
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perspectives of senior management in the Department of Education 
were congruent with the former Minister of Educations views. 

Teacher evaluation policy adoption by senior management in 
the Alberta Department of Education can be characterized as an 
evolutionary response to a series of events over a period of 
approximately 16 years, dating from the introduction of locaUy 
appointed superintendents in 1971. 

Respondents indicated a high degree of concensus regarding 
several factors which affected the adoption of teacher evaluation 
policy by the Alberta Department of Education, including: 

1) the Teaching Professions Act negotiations 
breakdown; 

2) the general absense of routine teacher 
evaluation under locally appointed 
superintendents ; 

3) the perceived need for improvement in the 
quality of instruction and diffuse 
environmental demands for accountability; 

4) specific concerns regarding the need for 
teacher evaluation by the Premier and caucus; 

5) the opportunity of linking teacher evaluation 
to a policy driven, post-audit Management and 
Finance program thrust by the Department of 
Education; 

6) the logical connection between policy 
implementation of student evaluation and the 
need for concomitant teacher evaluation 
policy; 

7) lack of action on teacher evaluation by the 
Alberta Teachers 1 Association or local school 

J Ui. JLOUJLUU.'.VllO f WliV*/ 

8) solidarity and concensus among senior 
management in the Department of Education 
regarding the policy directions necessary in 
response to the above. 



Conditions Affecting Policy Implementation 



Teacher evaluation policy implementation was strongly 
affected by a specific environmental event, the Keegstra affair, 
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and by the internal development of the Management and Finance 
Plan of the Alberta Department of Education, other factors which 
were seen as affecting the implementation process included: 

1) the Alberta Teachers' Association position on 
formative and summative evaluation as a barrier 
to implementation; 

2) the Department's requirement of teacher evaluation 
policy approval which served as a potential source 
of misunderstanding; 

3) the under-supply of staff skilled in teacher 
evaluation; 

4) the effect of role shifts from consulting to 
monitoring in the Regional offices of Education; 

5) the support of the Alberta School Trustees' 
Association and the Council of Alberta School 
Superintendents ; 

6) the difficulty of the appeal process in small 
jurisdictions; 

7) the visible and practical support of the Mireau 
inservice materials; and, 

8) the former Minister of Education's interest in 
evaluation in educational systems. 

Most phase I interviewees perceived the Keegstra affair, a 
widely publized case involving an Alberta teacher who was 
dismissed for teaching anti-Semitic doctrine in his Social 
Studies classes (David, 1983), as a catalyst to teacher 
evaluation policy implementation in terms of limiting the 
potential resistance of the Alberta Teachers' Association, and in 
keeping public awareness of the issue high only the former 
Minister of Education noted the 

* - - " -.-g*.v*?v I. Ui, Uilti 

Keegstra affair with respoct to its limiting opportunity for 
teacher input into the policy development process at the local 
jurisdictional level. 

The Keegstra affair represents a classic example of how an 
extraneous, environmental event can dramatically affect the 
policy implementation process. 
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The Management and Finance Plan of the Alberta Department of 
Education represents an important teacher evaluation policy 
implementation vehicle. The high visibility of the MFP, and the 
commitment to it by senior management in the Department, coupled 
with the symbolic if not real requirement of teacher evaluation 
policy implementation by local jurisdictions as a pre-requisite 
for funding, resulted in the policy maker interviewees perceiving 
it as a powerful implementation instrument. 

The Alberta Teachers 1 Association was perceived by senior 
management in the Department of Education as a barrier to 
implementation in terms of its insistence that formative and 
summative functions of evaluation must be separate, and in terms 
of its general organizational role. 

Teacher evaluation policy was the only policy that had to be 
approved by the Department of Education. While this policy 
standard was meant to facilitate the process, in some cases it 
caused some misunderstanding regarding the role of the department 
in the policy development process, or resistance to the 
requirement by policy implementors. 

Concerns regarding the undersupply of skilled evaluative 
Staff; role Shifts consultation to monitoring by tha 

Departments Regional Offices of Education, and problems with 
appeal processes in small jurisdictions were mentioned by only 
one or two interviewees, but provide useful points of comparison 
with the characteristics of the implementing agency, 
communications, and resource variables of the Van Horn and Van 
Meter (1977) puxxcy implementation model. 

• 164 



152 



Likewise, Alberta School Trustees 1 Association and Council 
of Alberta School Superintendents 1 support for teacher evaluation 
policy, the Mireau teacher evaluation inservice materials 
produced by the Department of Education and the former Minister's 
ongoing interest in evaluation were mentioned by on', interviewee, 
but these themes are relevant to the policy implementation model 
used in the study. 

Social Structures or Informal Networks 

Informal networks or their absense played an important role 
in the development of teacher evaluation policy in Alberta. 
Specifically, informal contacts with the Alberta School Trustees 1 
Association seem to have provided for better communications 
between the Department of Education and that body. The absence 
of informal communication mechanisms between the Department and 
the Alberta Teachers 1 Association may have exacerbated the 
tensions between the ATA and Department with respect 'o teacher 
evaluation policy development. 

Policy intents 

Overall, the policy implementors in the field perceive the 
purposes or intents of teacher evaluation at the provincial level 
largely as a demonstration of accountability or a Department of 
Education response to political events. One third of the 
respondents did perceive the intent of improving teaching/ 
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however, only one respondent identified enhancement of the 
teaching profession as an intent of provincial policy. 

On the other hand, 74 of 90 respondents linked improvement 
of teaching as a policy intent at the jurisdictional level, 
suggesting that a translation of this policy intent between 
organizational levels has occurred. Essentially, implementors 
perceive teacher evaluation policy at the provincial level to 
have a summative emphasis intended to demonstrate accountability, 
and at the jurisdictional level to have a formative emphasis 
intended to assist teachers to improve their instruction. 

The enhancement of the professional status of teaching as a 
policy intent was also abseni at the jurisdictional level. Since 

. .professional growth and development of teachers" (Alberta 
Education, 1984:72) is a stated intent of provincial teacher 
evaluation policy and was underscored as a policy intent by most 
of the policy makers, the almost complete absence of this policy 
intent in the perception of policy implementors warrants careful 
conr^ deration by both policy makers and policy implementors. 

Policy Standards and Resources 

Due process requirements as a policy standard have not 
presented any difficulties for policy implementors, but this area 
is also largely untested with none of the thirty jurisdictions 
sampled reporting an appeal to the formal stage. Concerns were 
expressed, primarily by superintendents, about problems of appeal 
procedures in small jurisdictions. 
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Policy resources were not assessed through direct questions 
in phase II interviews, but content analysis of the interview 
database revealed that concerns over "time" as a resource for 
teacher evaluation policy implementation occurred frequently. 

Within the Alberta context, the variable clusters, policy 
standards and policy resources reflect minimal provincial 
involvement relative to teacher evaluation policy implementation. 

General Impressions of the Policy Implementors 

General impressions of policy implementors reveal that 
superintendent respondents are most positive regarding teacher 
evaluation policy implementation, and teachers are least 
positive. However, teacher respondents expressed more positive 
than negative comments regarding their general impressions of 
teacher evaluation policy implementation. 

Process Variable Effects on Implementation 

Five process variables from the Van Horn and Van Meter 
(1977) policy implementation model, communications, enforcements, 
characteristics of the implementing ageucy, political 
environments and socio-economic environments were examined in 
relationship to phase II interviews and in terms of their effect 
on teacher evaluation policy implementation in Alberta. 
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Communications 

Communications regarding role responsibilities relative to 
teacher evaluation are clearer for administrators than for 
teacher respondents. This finding is not surprising given the 
recognition that teachers felt they had less opportunity for 
input into policy formulation than did the administrator 
respondents. Some clarification of policy, particlularly for 
teachers, but also for principals and superintendents in several 
jurisdictions is needed. 

Enforcements 

Administrator respondents view the enforcements used to 
induce teacher cooperation with teacher evaluation policy as a 
more positive process than do the teacher respondents. However, 
the emphasis on improvement of instruction given to 
jurisdictional level policy intents is apparent in the 
prepondance of normative enforcement strategies reported by 
administrators at the local level of implementation. 

Twenty-seven superintendent respondents reacted either 
favorably or with mixed support for provincial enforcement 
strategies. However, 18 superintendent respondents made 
suggestions regarding how provincial enforcements might be 
adjusted w*iich indicates a need to review enforcement strategies 
by provincial officials. 
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Ch aracteristics of the Implementing Agency 



Characteristics of the implementing agency refers to the 
technical capacity of the school jurisdiction to implement 
policy. In 12 of the 30 jurisdictions sampled, principals are 
primarily responsible for all teacher evaluation, with central 
office personnel providing only a backup role when needed. In 
the other 18 jurisdictions sampled teacher evaluation is a shared 
responsibility between principal and superintendent. 

It is significant that few jurisdictions have given a 
priority to teacher inservice on teacher evaluation specifically. 
Several administrator respondents commented that the professional 
development concern/priorities have passed on to other needs, it 
is clear that principals have had opportunity to experience some 
inservice training in support of their teacher evaluation 
responsibilities. Superintendent respondents, like their 
principal counterparts, have had opportunity to experience some 
inservice training in support of their evaluation activities. 
Principals suggested a greater need for additional inservice 
training than did superintendents. 

The strongest single theme to emerge from analysis of the 
question about satisfaction with evaluation methods in use was 
the preference expressed by many respondents for anecdotal 
evaluation reporting formats. Overall 64 of 90 respondents 
expressed high or moderate levels of satisfaction with methods 
used to evaluate teacher performance, however, divergence of 
opinion regarding evaluation methodology supports the wisdom of 
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designing evaluation methodology to fit local evaluation intents 
and expectations. 

Political Environments 

In those jurisdictions where teacher evaluation was seen as 
a local issue, it was perceived to be of a minor nature usually 
based on community dissatisfaction with an individual teacher. 
Significantly, no phase II respondent indicated that teacher 
evaluation had been a major political issue in their 
jurisdiction. 

Political support for teacher evaluation does not appear to 
have been a grass roots phenomenon that was manifested through 
local political channels. The majority of school jurisdictions 
sampled have taken no action or minimal action to communicate to 
their publics about teacher evaluation policy implementation and 
thus engender greater community support for continued 
implementation of this policy initiative. 

Socio-Economic Environments 

This variable cluster was the most elusive to tap given the 
specific policy being studied and the context of implementation. 
None of the pilot questions in the phase II interviews survived 
the interview schedule development process to assess the 
socio-economic variable cluster directly. In addition, the 
background literature review did not identify local 



170 



158 



socio-economic factors as being important to the implementation 
of teacher evaluation policy. Essentially, factors which were 
identified as important seemed to be adequately covered by the 
other seven variable clusters of the Van Horn and Van Meter 
(1977) policy implementation model relative to the particular 
application cf the model in the current st.udy. 



Disposi tion of the inplementor s 



Analysis of the crucial process variable, disposition of the 
implementors, of the Van Horn and Van Meter (1977) model revealed 
a substantial base of support for teacher evaluation policy by 
members of the teaching profession, but also the presence of a 
number of concerns, which if not addressed, could result in 
increasing resistance by teachers to implementation of teacher 
evaluation policy in Alberta. 

inadequate time for implementation of teacher evaluation 
policy was the most frequently mentioned item that had presented 
a problem to implementors. Perhaps most importantly, principal 
respondents, who are crucial to the teacher evaluation process, 
expressed their concern over inadequate time and resources twice 
as often as superintendent respondents. Teacher respondents 
identified this araa as a problem for their principals almost as 
often as the principal respondents, lending credibility to the 
principal respondents' concerns. 

Teacher and principal respondent categories also exhibited 
close agreement in terms of the numLers of responses relative to: 
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1) the need for evaluators to have more training and an improved 
empirical basis for evaluation; and 2) the existence of role 
confusion between summative and formative evaluative efforts and 
the lack of direction with respect to the overall teacher 
evaluation processes. 

Fifty-nine of the ninety respondents believed the Department 
of Education's commitment to teacher evaluation policy 
implementation to be weaker or were not sure or held no opinion. 
Administrator respondents held this perspective more often than 
did teacher respondents. 

At the local level superintendents perceive th^ir school 
boards to be maintaining a high commitment to implementing 
teacher evaluation policy, with 25 of the 30 jurisdictions 
sampled reporting a high commitment by their boards to 
implementation of teacher evaluation policy. Concern was 
expressed by the researcher that ten of the boards with a high 
commitment are not seen by their superintendents to be actively 
demonstrating this commitment and an additional five of the 
thirty school boards sampled are percieved to have moderate or 
low commitment and are also not actively expressing a commitment 
to implementation of teacher evaluatipn policy. The perception 
of many policy implementors that the Department of Educations 
commitment is declining could be reinforced by a perception that 
board commitment is also declining. 
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Policy Effects 

While large proportions of phase II administrator 
respondents identified evidence teaching was improving, staff 
satisfaction/positive teacher attitude, and administrative 
commitment to evaluation as indicators of successful policy 
implementation, very few teacher respondents identified these 
factors. On the other hand, two-thirds of the teacher 
respondents stated that evaluations that were informative/useful 
to them would be indicative of successful teacher evaluation 
policy implementation, whereas few administrators suggested this 
factor. 

A small but similar proportion from each phase n respondent 
group suggested successful policy implementation would be 
indicated if public confidence in education was enhanced, and if 
the clarity and consistency in evaluation criteria w^re achieved. 
Nine administrator respondents also suggested enhancement of 
evaluation skills with resultant improvement in the quality of 
teacher evaluation, and six statod personnel decision making 
based on evaluation results would reflect successful teacher 
evaluation policy implementation. 

The policy implementors conceptualization of successful 
policy implementation is relatively congruent with the idealized 
policy intents identified by the policy makers. Teacher 
satisfaction with teacher evaluation, useful and informative 
evaluations, and administrative commitment to teacher evaluation 
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suggested by policy implementors would all be indicative of the 
institutionalization of teacher evaluation policy which policy 
makers stated would be an ideal condition, The former Minister 
of Education's objective of elimination of incompetent teaching 
and improvement of teaching quality is congruent with the 
implementors ' identification of evidence that teaching was 
improving as an indicator of successful policy implementation. 
The implementors identification of improvement of public 
confideroe in education is identical to the former Minister's 
stated objective of "contributing to increased public confidence 
in the educational system." 

Numerous points of agreement appear to exist between the 
perspectives of policy makers and policy implementors regarding 
what ideal teacher evaluation policy implementation would be 
like. Granted, concensus likely does not exist on how to best 
achieve this idealized policy state,, but the fact that multiple 
points of agreement exist between policy makers and implementors 
suggests that eventual full implementation of teacher evaluation 
policy is a reasonable objective. 

Expectations for Full Implementation 

In phase I interviews, policy makers were asked what their 
perceptions of the current status of teacher evaluation policy 
implementation were. Analysis of their responses indicated that 
policy makers do not believe teacher evaluation policy 
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initiatives will dissipate; however, they also did not think that 
implementation is anywhere near complete. 

Administrative policy implementors in phase II interviews 
were asked, how many schools, if any, have implemented the 
teacher evaluation policy, either fully or partly in their 
jurisdictions. 

Twenty-three principal and nineteen superintendent 
respondents stated teacher evaluation policy had been fully 
implemented in their jurisdiction. Six of these forty-two 
respondents qualified their statement that "fully" meant in terms 
of the mechanics of the policy. That is, the policy standards 
were in place, but the policy effects, characteristics of the 
implementors, etc., may be yet lacking. 

Seven principal and 11 superintendent respondents stated 
teacher evaluation policy had been partially implemented in their 
jurisdiction. These respondents often cited implementation 
barriers, such as time, the newness of the policy, or the 
discomfort of principals with it as factors which had inhibited 
full implementation. 

The researcher was surprised that such a high proportion of 
administrator respondents (42/60) were willing to characterize 
teacher evaluation policy as fully implemented, despite the fact 
that earlier questions in the interview identified areas where 
implementation barriers existed. Essentially, most administrator 
respondents seemed comfortable with a fairly superficial 
definition of full policy implementation. This may have been due 
to the mandatory nature of t evaluation policy 
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implementation that the provincial policy makers created and the 
resultant pressure on implementors to demonstrate full 
implementation • 

Ironically, the interviews with the policy makers revealed 
that they believed teacher evaluation policy to be in the process 
of implementation, but that full implementation was a longer term 
process, and one that may require adjustments in terms of 
resources, characteristics of the implementing agencies, policy 
standards, and other factors, before full implementation could be 
expected. 

A communication gap see^s to exist between the expectations 
of the policy makers and the policy implementors relative to a 
realistic timeline for full implementation of teacher evaluation 
policy. This question of full implementation and the mechanisms 
required to achieve it, is a topic which will require further 
dialogue between policy makers and implementors. 

Future Adjustments 

The future will likely require thvS creation of mechanisms 
.that will provide for more teacher involvement in the evolution 
of teacher evaluation processes in Alberta. In addition, the 
expertise base and resources in support of teacher evaluation 
will need enhancement. Court cases questionning the expertise of 
evaluators and collective agreement negotiations focusing on 
teacher evaluation procedures might also be future forces shaping 
teacher evaluation in the province. 
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Analysis of Teacher Evaluation Policies 

The greatest similarities between the thirty policy 
documents analyzed involved the policy intent of improving 
instruction and the specification of various evaluation schedules 
relative to a teachers employee status. These were the only 
content areas which all thirty policy documents universally 
addressed. Most policies also addressed the disposition of 
teacher evaluation reports. 

Moderate similarities, where between forty to eighty-five 
per cent of the documents concurred, included the policy intents 
of: personnel decisions, continous contract decisions, 
promotion, transfer and dismissal decisions, permanent 
certification decisions, affirmation or reinforcement of the 
teacher, and professional improvement. Formative and summative 
evaluation was defined in just over half of the documents and the 
roles of superintendents and principals were defined in eighty 
and eighty-three per cent of the policies respectively. 
Procedures for assisting teachers in difficulty or remedial 
processes were identified in sixty per cent of the documents. 
Self-evaluation and peer evaluation was encouraged in sixty-three 
per cent o.t the documr>its and post-conferences were required or 
suggested in eighty- three per cent of the policies. Teacher role 
expectations or the specific evaluation criteria were identified 
in eighty per cent of the policy documents. 

Appeal procedures were present in most policies and in the 
three that excluded appeal procedures, one stated the possibility 

ERIC 177 



165 



of appeal and another policy x>cument was in the process of 
revision. Appeal procedures, however , demonstrated a markad lack 
of similarity with eighty per cent of the documents specifying 
appeal timelines, and only twenty-seven per cent explicitly 
stating the bases of appeal. Few documents identified provincial 
or federal appeal options which may exist outside the local 
appeal procedures, such as is defined in the Alberta school Act. 

Minimal similarities existed between policy documents 
regarding: teachers 1 right to known, common evaluation criteria; 
the relationship of teacher evaluation to assessing 
jurisdictional inservice needs; roles of teachers within the 
evaluation process; and pre-conferencing requirements. 

These minimally and moderate 1 * prevalent items within the 
policy documents represent potentially useful additions to policy 
documents which lack them, and as such offer a useful framework 
for future policy review by jurisdictional staff. 

Policy requirements for mandatory evaluation of permanently 
certified, tenured teachers did not vary significantly from 
figures reported in a 1980 survey of teacher evaluation practices 
in Alberta (Alberta Education, 1980:13) which demonstrates that 
untenured or temporarily certificated teachers are the primary 
focus of current teacher evaluation policies. 

Analysis of Teacher Evaluation Instruments 

Evaluation instruments were also analyzed to determine the 
similarities and differences that existed between jurisdictions 
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and to compare the internal structure and content of the 
instruments. Creation of a universal teacher evaluation 
instrument was not suggested; however, review of evaluation 
instruments by jurisdictional staff, using the categories noted 
below, is suggested to assure that evaluation instruments are as 
comprehensive as desired. 

Twenty policy documents mandate teacher signatures as an 
indication that the individual teacher has seen and/or discussed 
the results of the evaluation. However f nly sixteen of the 
evaluation instruments provide for this policy requirement. 

Consolidated or summary reports, useful in focusing the 
evaluation results, and evaluation purposes, useful in clarifying 
the objectives of an evaluation, are included in twenty-three per 
cent of the instruments. 

Few instruments included a statement about the appeal 
process. This ±tem would be useful since many teachers may not 
have ready access to the appeal procedures defined in teacher 
evaluation policy documents. Fev instruments included teacher 
role expectations; however, many instruments included evaluation 
criteria which accomplices the same objective of clarifying the 
criteria on which teachers are evaluated. 

Post conferences are required by most jurisdictions, but 
details regarding such conferences are included on only seven per 
cent of the evaluation instruments. Rating scales are included 
in half of the instruments, but are defined in only seven per 
cent of the instruments. Underlying philosophies are clarified 
in nearly half of the policy documents analyzed, but again such 
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statements are present in just seven per cent of evaluation 
instruments. 

Policy and Instrument Congruence with Study Findings 

Congruence between study findings and policy documents and 
evaluation instruments was reviewed relative to policy intents, 
role responsibilities and preferred evaluation instrument 
formats . 

Provincial policy (Alberta Education, 1984:72) specifically 
identifies the intent of 11 . . .professional growth and 
development of teachers." The almost total absence of this 
intent in the perception of policy implementors and in almost 
half of che policy documents represents an area in need of review 
by both policy makers and policy implementors. 

Policy implementors were asked during phase II interviews if 
policy expectations were clear with respect to their role 
responsibilities. Administrator respondents expressed little 
confusion regarding their policy related responsibilities. 
Teachers, however, were the least clear regarding their teacher 
evaluation role responsibilities. The policy docomenta analysis 
revealed that superintendents and principals are most often 
identified as having specific role responsibilities. On the 
other hand, *^achers e roles relative to teacher evaluation policy 
is addressed in aniy seventeen per cent of the policy documents. 
Inclusion of teacher role responsbililities in teacher evaluation 
policy documents would help to clarify teacher responsibilities. 
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Lastly, policy implementors were asked if they were 
satisfied with the methods used to measure teacher performance. 
The strongest single theme to emerge from this question was the 
preference expressed by many respondents for anecdotal evaluation 
reporting formats. The analysis of teacher evaluation documents 
found that anecdotal formats, used either independently or in 
conjuction with rating scales, occured in at least ninety per 
cent of the jurisdictions sampled. Use of anecdotal formats, 
identified as commonplace currently, should continue. 

Recommendations for Theory 

Policy implementation studies represent a method for 
conducting process evaluations before policy impact assessments 
or product evaluations should be conducted. Consequently, 
implementation studies can inform srA help structure subsequent 
impact studies. 

Any search for a single, predictive theory of policy 
implement' on is likely to suffer the same fate as that of 
attempts to develop single, predictive theories of leadership or 
organizational behavior. That is, no single theory is likeJy to 
be sensitive to the complex, synergistic interaction between 
variables which are conditioned by the unique context of a 
particular organization or policy. Recogni2ing this, policy 
theorists should maintain an eclectic view of the policy 
implementation literature and subscribe to an adaptive theory 
which relates variables to the specific policy implementation 
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environment which they are studying. Backward mapping (Elmore, 
1979)/ and more traditional forward mapping techniques designed 
to assess the underlying causality of policies and policy 
objectives offer useful methods for assessing the variable 
clusters or policy theory which can optimally be used for study 
of a given policy context. 

Policy implementation models such as Van Horn and Van Meter 
(1975 f 1977) and Mazmanian and Sabatier (1981) are two examples 
of comprehensive frameworks that offer complex sets of variables 
at different levels of specificity which are potentially valuable 
to the study of policy implementation. 

Recommendations for Practice 

The following recommendations are made relative to the 
implementation of teacher evaluation policy in Alberta: 

1) the often held perspective of local policy implementors 
that teacher evaluation policy adoption by the Alberta Department 
of Education was a short term reaction to a single event/ the 
Keegstra affair, sJ^ould be corrected with the view that policy 
adoption was a more leg'timate long t^rai reaction to multiple 
factors ; 

2) provincial policy objectives should be adjusted to 
recognize and support the more formative emphasis teacher 
evaluation has been given at the local level; 

3) given the finding that the professional growth and 
development of teachers is generally not perceived as a policy 
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intent of current policy, this intent should either be dropped 
from policy or strategies identified that give clear and tangible 
support to this policy objective; 

4) given the finding that implementors perceived provincial 
commitment dissipating, provincial interventions are needed to 
maintain a climate in which teacher evaluation policy 
implementation is perceived as being important; 

5) given the finding that lack of time was frequently 
mentioned as a barrier to implementation, recognition that 
imiplementors may need assistance in more efficient use of their 
time to support teachei evaluation policy should become a 
priority of jurisdictions and the Department of Education; 

6) given the finding that political motivation for teacher 
evaluation policy is stronger at the provincial level than at the 
local level, recognize that the disposition of implementors is 
not likely to be supported from the local political environment; 

7) given the finding that implementation pressures related 
to the Keegstra affair are dissipating, this enforcement factor 
should ba replaced with more normative incentives; 

8) based on the Connecticut model, consideration should be 
given to expanding the role of the Council on Alberta Teething 
Standards (COATS) , or creating an independent board, to provide 
for on-going monitoring and/or assistance to jurisdictions in the 
implementation of teacher evaluation policy; 

9) given the finding that articulation between the five 
provincial evaluation policies was often perceived by 
implementors to be unclear, the Department of Education should 
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review the five provincial evaluation policies included in the 
Management and Finance Plan in order to define an opt?*al, 
articluated relationship between the five policies; 

10) given the finding that many administrators reported 
difficulties in implementating teacher evaluation policy, 
recognize that evaluator expertise is developed over the long 
term and provide on-going mechanisms to facilitate continued 
evaluator skill development; 

11) given the finding that teachers have had little 
opportunity for inservice regarding their roles relative to 
teacher evaluation consider prioritizing such inservice 
opportunities ; 

12) givan the finding that anecdotal evaluation reporting 
formats are preferred by implementors and are also supported in 
the literature on teacher evaluation methodology (Shavelson, 
Webb, and Burstein, 1986) , continue or incorporate such reporting 
formats where warranted and consider discon -inuing use of rating 
scales; 

13) given the finding that teachers are least clear 
regarding their teacher evaluation role responsibilities, provide 
for new opportunities for administrator-teacher collaboration at 
the local level to further define teacher understanding of the 
teacher evaluation goals and purposes; 

14) given the finding that policies and instruments are 
potentially incomplete, jurisdictions should review their teacher 
evaluation policy aocuments ana evaluation instruments relative 
to the variables identified in Chapter Eight of this study to 
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assure policies and instruments are as complete and fine tuned as 
is desirable; 

15) given the finding that teachers report less involvement 
in policy development than perceived by ? iministrators, as part 
of the policy and instruments review process, mechanisms should 
be considered which maximize teacher involvement in the process 
in order to increase the sense of teacher ownership of teacher 
evaluation policies and processes; 

16) given the finding that appeal procedures in small 
districts present potential problems a staff resources list of 
approved and available personnel to supplement the appeal 
procedures of small school jurisdictions should be compiled and 
disseminated by the Department of Education; 

17) given the finding that administrator implementors appear 
to feel a need to demonstrate a degree of implementation that is 
not congruent with the expectations of the policy makers , 
clarification of realistic timelines for full implementation by 
policy makers would be useful; 

18) given the recognition that implementation studies should 
precede policy impact utudies, begin planning the method, design 
and timeline of a policy impact assessment of teacher evaluation 
policies in Alter ca using the current study and previous studies 
(Duncan, 1985) as baseline data, and provide for widespread 
dissemination of the impact study plan. 
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Recommendations for Further Research 

In-house case studies by school jurisdictions using the 
phase II interview schedules employed in the present study would 
*>e useful to specific jurisdictions wishing to compare their 
jurisdictional teacher evaluation policy implementation status 
with the province wide findings reported above. 

Further research into the local political environment via 
interviews or surveys of school board trustees regarding their 
perceptions of political pressures for teacher evaluation would 
add to our understanding of the role of trustees in the teacher 
evaluation policy process in particular and to the role of 
trustees in policy formulation In general. 

The function of time as a barrier to implementation of 
teacher evaluation requires further study to identify how this 
barrier can best be addressed and reduced or eliminated as an 
impediment to teacher evaluation. 

Further investigation of the Van Horn and Van Meter (197V) 
policy implementation model using quantitative research 
methodology and factor analytic validation techniques would be 
useful to further clarify the relevance of variable clusters to 
policy implementation Btudies in different settings. 
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Final Comment 

A common word of advise found in tho policy literature is 
the prescription to never assume a policy will be fully 
implemented on the basis that it has been formally adopted. The 
recommendations noted above underscore the tenuous nature of 
teacher evaluation policy implementation. Forces for and against 
implementation of teacher evaluation policy are becoming 
entrenched. The comments of one principal respondent are 
particularly poignant, "Teacher evaluation is such an abstract , 
nebulous area that you can avoid doing it without too much 
political damage." Whether a stalemate of mediocrity ensues or a 
new age of teacher pr fessionalism emerges will be dependent on 
the actions of both policy makers and policy implementors over 
the next few years. 
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Appendix A 



Implementation of Teacher Evaluation Policy 
Teacher interview schedule 



1. Would you share with me your general thoughts on teacher 
evaluation policy implementation in your school? 



2. What do you believe are the purposes of the teacher 
evaluation policy at the provincial level? 

3. What, in your opinion, are the purposes of your 
jurisdiction's teacher evaluation policy? 

4. What would you look for in making a decision as to whether 
the policy has been sucessfully implemented in your school? 

5. Have you had any training specifically in teacher evaluation? 

What training has been most helpful? 
What training would be helpful? 

6. To what degree are you satisfied with your jurisdiction's 
methods used to measure teacher performance? 

7. What means bave been used in your school to encourage 
teachers to cooperate with the teacher evaluation policy? 

How effective have these been? 

8. Has anything weakened your support for implementation of your 
jurisdiction's teacher evaluation policy? 

9. Have any aspects of the teacher evaluation policy caused 
implementation difficulties for your school f s administrative 
staff? 

10. In what way were the teachers involved in developing your 
jurisdiction's teacher evaluation policy? 

11. Are policy expectations from the school office sufficiently 
clear from your point of view to define what is expected of you 
in the implementation process? 
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12. Do you think the Alberta Department of Education's 
commitment to having tb N provincial teacher evaluation policy 
implemented is as strong today as it was in 1984-85 when it was 
introduced? 

What are the reasons for this opinion? 

13. Are there any future needs, supports or adjustments which 
you think may be necessary to assure teacher evaluation has a 
positive influence in your school? 
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Appendix B 



Implementation of Teacher Evaluation Policy 
Principal Interview Schedul e 



1. Would you share with me your general thoughts on teacher 
evaluation policy implementation in your jurisdiction? 



2. What do you believe are the purposes of the teacher 
evaluation policy at the provincial level? 

3. What, in your opinion, are the purposes of your 
jurisdiction's teacher evaluation policy? 

4. What would you look for in making a decision as to whether 
the policy has been sucessfully implemented in your jurisdiction? 

5. Have you had any training specifically in teacher evaluation? 

What training has been most helpful? 

What training would be helpful? 

6* Have the teachers in your school had any specific training 
to facilitate and cooperate with teacher evaluation? 

What training has been most helpful? 

What training would be helpful? 



7. To what degree are you satisfied with your jurisdiction's 
methods used to measure teacher performance? 

8. What means have been used in your jurisdiction to encourage 
principals to implement the teacher evaluation policy? 

How effective havv* these been? 

9. What means have been used in your school to encourage 
teachers to cooperate with the teacher evaluation policy? 

How effective have these been? 

10. Has anything weakened your support for implementation of 
your jurisdiction's teacher evaluation policy? 

11. Have any aspects of the teacher evaluation policy 
implementation resulted in resistance by teachers? 
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12. In what way were the teachers involved in developing your 
jurisdiction's teacher evaluation policy? 

13. Has the 'due process' requirement of the Alberta Department 
of Educaton caused implementation difficulties in your 
jurisdiction? 

14* Are policy expectations from the central office sufficiently 
clear from your point of view to define what is expected of you 
in the implementation process? 

15. How has implementation been affected by the jurisdiction's 
political climate? For example, was teacher evaluation an issue 
in the October 20, 1986 board elections? 

16. Have you tried to make parents or parent groups aware that a 
new teacher evaluation policy is being implemented in your 
school? How effective has this been? 

.'7. In your judgement, how many schools, if any, have 
implemented the teacher evaluation policy? Partly ? 
Fully ? 

18. Do you think the Alberta Department of Education's 
commitment to having the provincial teacher evaluation policy 
implemented is as strong today as it was in 1984-85 when it was 
introduced? 

What are the reasons for this opinion? 

19. Are there any future needs, supports or adjustments which 
you think may be necessary to assure teacher evaluation has a 
positive influence in your school? 
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Appendix C 



Im plementation of Teacher Evaluati on Policy 
superintendent Interview schedule 



1. Would you r^are with me your general thoughts on teacher 
evaluation policy implementation in your jurisdiction? 

2. What do you believe are the purposes of the teacher 
evaluation policy at the provincial level? 

3. What, in your opiixion, are the purposes of your 
jurisdiction's teacher evaluation policy? 

4. What would you look for in making a decision as to whether 
the policy has been sucessfully implemented in your jurisdiction? 

5. The Alberta Department of Education has used "must do'* 
statements to ensure th* ' school jurisdictions implement teacher 
evaluation policy. Wha has been your reaction to the 
appropriateness of these means used to ensure compliance with 
provincial mandates to implement teacher evaluation policies? 

6. Would you recommend other means to ensure compliance with the 
provincial policy? 

7- Who has responsibility for evaluating teachers in your 
jurisdiction? 

8. Have the central office administrative/supervisory staff in 
your jurisdiction had had any training specifically in teacher 
evaluation? 

What training has been most helpful? 
What training would be helpful? 

9. Have the school based administrative/ supervisory staff in 
your jurisdiction had any training specifically in teacher 
evaluation? 

What training has been most helpful? 

What training would be helpful? 



9 

ERIC 



204 



192 



10. Have the teachers in your jurisdiction had any specific 
training to facilitate and cooperate with teacher evaluation? 

What training has been most helpful? 

What training would be hr.lpful? 

11. To what degree are you satisfied with your jurisdictions 
methods used to measure teacher performance? 

12. What means have been used in your jurisdiction to encourage 
principals to implement the teacher evaluation policy? 

How effective have these been? 

13. What means have been used in your jurisdiction to encourage 
teachers to cooperate with the teacher evaluation policy? 

How effective have these been? 

14. What is the priority of evaluating teachers for board 
members? 

15. Has anything weakened your support for implementation of 
your jurisdictions teacher evaluation policy? 

16. Have any aspects of the teacher evaluation policy 
implementation resulted in resistance by teachers? 

17. In what way were the teachers involved in developing your 
jurisdictions teacher evaluation policy? 

18. Has the 'due process 1 requirement of the Alberta Department 
of Educaton caused implementation difficulties in your 
jurisdiction? 

19. Are policy expectations from the Alberta Department of 
Education sufficiently clear from your point of view to define 
what is expected of you in the implementation process? 

20. How has implementation been affected by the jurisdictions 
political climate? For example, was teacher evaluation an issue 
in the October 20, 1986 board elections? 

21. Have you tried to make parents or parent groups aware that a 
new teacher evaluation policy is being implemented in your 
jurisdiction? How effective has this been? 

22. In your judgement, how many schools, if any, have 

implemented the teacher evaluation policy? Partly ? 

Fully ? 
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23. Do you think the Alberta Department of Education's 
commitment to having the provincial teacher evaluation policy 
implemented is as strong today as it was in 1984-85 when it was 
introduced? 

What are the reasons for this opinion? 

24. Are there any future needs, supports or adjustments which 
you think may be necessary to assure teacher evaluation has a 
positive influence in your jurisdiction? 
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Appendix D 

Department of Educational Administration 
Faculty of Education 



Canada T6G2G3 



7-104 Education Building North, Telephone (403) 432-5241 



September 8, 19W 



I an presently conducting a study of teacher evaluation policy 
implementation in Alberta. The project has received funding support 
from Alberta Education and is being undertaken as a doctoral study In 
the Department of Educational Administration at the University of 



Phase 1 of the study has involved interviews with decision natters 
and other persons who were influential in the adoption of teacher 
evaluation policy. The priaary purpose of the first phase of the study 
was to identify the intents of teacher evaluation policy. 

Phase 2 of the study will assess the effects of teacher evaluation 
policy implementation. Information for this phase will be collected in 
interviews with personnel form various Alberta School jurisdictions. 

The purpose of this tetter is to ask permission to interview you 
and two other individuals in your jurisdiction. Anonymity of 
respondents will be assured, and the data will be reported without 
identifying responses with individual respondents or their 
jurisdictions. 

Interviews will last approximately one hour with the superintendent 
or his designate responsible for teacher evaluation policy 
implementation. In addition, a principal and a teacher, randomly 
selected from the jurisdiction, will be interviewed. Interviews are 
tentatively planned for late September, October, and November 193d. 

The results of the study will be reported to the Planning Services 
Branch of Alberta Education. Results, it is anticipated, will be 
distributed to all school jurisdictions in the province. 

If your jurisdiction egrets to participate in the study, may I 
request it) an up to date staff list to facilitate selection of a 
principal and teacher for interviews, and <2) a copy of your teacher 
evaluation policy document. Once all participating jurisdictions are 
confirmed, I will contact you so we may agree upon an Interview 



Alberta. 




schedule. 
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Thank you for considering thi* request. U there art any questions 
regarding tht study, please do not hesitate to contact rat (432-3094 on 
campus or 458-4064 residence). I will look forward to recieving your 
reply. 




John M. Burger 



208 



Appendix E 




EDUCATION 



Devonian BuMng, Watt Tower 
11100 Jaeper Avanue 
Edmonton, AJb«ta, Canada 
T6K0L2 

January 30, 1980 



To Alberta School System 
Superintendents 



Recently the Canadian Education Association, in cooperation with 
a number of other educational agencies, held a seminar on inservice and 
retraining of teacher, and administrators. The seminar I"??** 
tation from the major educational sectors across Canada and input from 
political and manpower specialists. 

In the absence of more substantial evidence, seminar participants 
relied on their perceptions in concluding that few comprehensive personnel 
development programs for educators exist in Canada and that a major barrier 
to providing adequate professional development program* for teachers and 
Hinistr^ors is the lack of comprehensive ongoing evaluation programs for 
t£m? "element of competent or outstanding teacher, appears inadequate. 
In aeneral. evaluation of teacher, and administrators occurs only in the 
arJt So year! of service in a position, during temporary appointment, or 
in crisis situations. In the crisis cases data often are not adequate a. 
a basis for decisions on termination. Ad hoc solutions seem to be the order 
of the day, and too often termination rather than improved performance is 
?he maj" objective. Except for Quebec, where after two year, of successful 
teaching a teacher has life tenure although not permanent job P^cement, 
policies on teacher redundancy generally are of a "last in, first out 
nature. 

If the situation as outlined pertains in Alberta school systems 
also, then improvement in personnel management procedures is e8 ? en JJ«*; 
Until 1970 the province had ongoing evaluation of teachers, with written 
reports considered an integral part of the teacher personnel file and 
deposited both locally and in the Registrar's office. Since 1970 the 
prime responsibility for teacher evaluation has rested with local J uri. 
dictions. A 1977 study conducted by Dr. E.A. Holdaway and Mr. M.J. ReiKie 
of the University of Albert, indicated that a substantial percentage (36X) 
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Alberta School System Superintendents 
January 30, 1980 
Page 2 



of Alberta School Jurisdiction* had no policy on frequency of evaluations of 
tenured teachers, and only 29X of jurisdictions had standard forms for use 
in conducting and reporting Rurh evaluations. There are no more recently 
collected data on the situation. 

The purpose of this letter is to obtain from you an outline of 
the evaluation policies and procedures followed for all certificated person- 
nel in your school system. A copy of relevant policy and procedures 
statements, with any attendant forms, would be appreciated. In addition I 
request that, whether or not you have such statements, you complete and 
return the attached brief questionnaire, which will facilitate summarizing 
the current situation in the province. 



May I have this information by February 18, 1980 please. 



Sincerely, 




Deputy Minister of 
Education 



c.c. 



Board Chairmen 
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